-- Logs begin at Thu 2022-06-30 12:06:44 UTC, end at Thu 2022-06-30 13:40:14 UTC. -- Jun 30 12:36:19.339435 dv-cinder-822821-3-smb systemd[1]: Starting Devstack devstack@keystone.service... Jun 30 12:36:19.346735 dv-cinder-822821-3-smb devstack@keystone.service[80092]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 30 12:36:19 2022] *** Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: nodename: dv-cinder-822821-3-smb Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: machine: x86_64 Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: clock source: unix Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: pcre jit disabled Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: detected number of CPU cores: 4 Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: current working directory: / Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: detected binary path: /usr/bin/uwsgi-core Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: your processes number limit is 47680 Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: your memory page size is 4096 bytes Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: detected max file descriptor number: 2048 Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: lock engine: pthread robust mutexes Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: thunder lock: enabled Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 30 12:36:19.352404 dv-cinder-822821-3-smb devstack@keystone.service[80092]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 30 12:36:19.395478 dv-cinder-822821-3-smb devstack@keystone.service[80092]: Python main interpreter initialized at 0x55cfae4999c0 Jun 30 12:36:19.395478 dv-cinder-822821-3-smb devstack@keystone.service[80092]: python threads support enabled Jun 30 12:36:19.395478 dv-cinder-822821-3-smb devstack@keystone.service[80092]: your server socket listen backlog is limited to 100 connections Jun 30 12:36:19.395478 dv-cinder-822821-3-smb devstack@keystone.service[80092]: your mercy for graceful operations on workers is 90 seconds Jun 30 12:36:19.395859 dv-cinder-822821-3-smb devstack@keystone.service[80092]: mapped 403077 bytes (393 KB) for 2 cores Jun 30 12:36:19.395924 dv-cinder-822821-3-smb devstack@keystone.service[80092]: *** Operational MODE: preforking *** Jun 30 12:36:19.396189 dv-cinder-822821-3-smb devstack@keystone.service[80092]: *** uWSGI is running in multiple interpreter mode *** Jun 30 12:36:19.396189 dv-cinder-822821-3-smb devstack@keystone.service[80092]: spawned uWSGI master process (pid: 80092) Jun 30 12:36:19.396425 dv-cinder-822821-3-smb systemd[1]: Started Devstack devstack@keystone.service. Jun 30 12:36:19.400425 dv-cinder-822821-3-smb devstack@keystone.service[80092]: spawned uWSGI worker 1 (pid: 80103, cores: 1) Jun 30 12:36:19.400425 dv-cinder-822821-3-smb devstack@keystone.service[80092]: spawned uWSGI worker 2 (pid: 80104, cores: 1) Jun 30 12:36:19.400425 dv-cinder-822821-3-smb devstack@keystone.service[80092]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 30 12:36:24.920765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:36:24.920765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: from cryptography.utils import int_from_bytes Jun 30 12:36:24.921535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:36:24.921535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: from cryptography.utils import int_from_bytes Jun 30 12:36:24.921661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:36:24.921661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: from cryptography.utils import int_from_bytes Jun 30 12:36:24.922103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 30 12:36:24.922103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: from cryptography.utils import int_from_bytes Jun 30 12:36:24.971461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:36:24.971611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:36:24.971757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] command line args: [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:36:24.972027 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:36:24.972204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ================================================================================ {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:36:24.972517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] admin_token = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.972654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 30 12:36:24.972779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 30 12:36:24.972859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] config_dir = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.973001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] command line args: [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 30 12:36:24.973115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.973249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] config_source = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.973328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 30 12:36:24.973426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ================================================================================ {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 30 12:36:24.973504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] debug = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.973623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.973865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] admin_token = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.973936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] config_dir = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.973999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] config_source = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] debug = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] list_limit = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.974963 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] log_config_append = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] log_dir = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] log_file = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] list_limit = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.975950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] log_config_append = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] log_dir = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] log_file = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.976978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977580 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.977895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.978980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] publish_errors = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.979988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.980133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.980306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.980486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.980591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.980665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] publish_errors = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.980810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.980895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] standard_threads = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] use_journal = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.981977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] standard_threads = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] use_json = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] use_stderr = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] use_syslog = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] use_journal = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.982874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.982974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] use_json = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.983058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.983154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] use_stderr = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.983306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.983391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] use_syslog = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.983547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.983629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 30 12:36:24.983797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.983876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.984872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.985995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.986959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.987969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.988052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.988238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.988504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.988648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.988750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.988828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.989991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.990919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.991905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.992939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.993946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.994961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.995902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.996062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.996139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.996477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.996621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.996723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.996819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.996914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.997913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.998910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999649 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:24.999892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.000871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.001952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.002964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.003120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.003198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.003360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.003438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.004159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.004251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.004422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.004570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.004709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.004811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.004974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.005052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.005143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.005270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.005508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.005620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.005735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.005959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.006951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.007923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] auth.external = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.008895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] auth.password = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] auth.token = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.009905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] auth.external = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.010995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] auth.password = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] auth.token = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] credential.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.011970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.012953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] credential.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.013935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.014936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.015971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.016137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.016216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.016666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.016765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.016899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.016987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.017948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.018922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.019082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.019878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.020065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.020240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.020485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.020651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.020752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.020832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.021933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.022941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.023100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.023179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.023345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.023432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.023599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.023679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.023836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.024894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.025986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.026955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.027919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.028962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.029936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.030876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.031976 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.032970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.033049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.033207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.033285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.033447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.033535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.038568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.038705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.038780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.038854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.038946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039309 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.039964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040112 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.040972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.041998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.042914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.043258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.043258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.043258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.043415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.043477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.043477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.043702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.044009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.044272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.044555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.044797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.045051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.045291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.045404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.045583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.045676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.045824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] role.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.045945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.046079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] role.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.046219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.046298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.046487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.046570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.048535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.048619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.048684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.048756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.048845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.048924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.048998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] role.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] role.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.049937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.050974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.051050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.051265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.051353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.051438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.051513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.051672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.051929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.052009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.052198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.052406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.052492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.054823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.054920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.054998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.055948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.056933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.057984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.058066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.058258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.058442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.058531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.058737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.058912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.058992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.059211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.059397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.059490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.059743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.059869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.060008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.connection = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.060256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.060376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.060531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.060765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.060904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.061008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.061286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.061432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.061553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.061679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.061818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.061930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.062904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.063985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.064096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.064218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.064366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.connection = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.064471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.064643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.064714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.064865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80103) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:36:25.064942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.065130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.065377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.065618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.065862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.066670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.066916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.067229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.067409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.067658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.067900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.068156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.068417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.068670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.068908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.069155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.069396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 30 12:36:25.069572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80104) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 30 12:36:25.096614 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.096841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.097077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.102082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.102318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.102542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.105810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.111049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.134764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.134985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.138831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.139063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.278816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.279084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.327980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.328213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.328520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.328760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.397287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.397513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.397736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.397955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.398169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.398307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.398395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.398544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.398770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.398991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.399212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.399430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.423169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.423395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.423603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.423706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.423817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.423900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.424930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.436101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.436640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.449501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.449733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.449950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80103) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.450881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.451040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.451258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.451475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80104) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 30 12:36:25.468105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.468227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.468306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 12:36:25.468419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 12:36:25.468656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.468854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 12:36:25.468936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.469078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 30 12:36:25.469159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.469348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.469437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.469601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.469683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.469854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.469944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.470110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.480829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.481101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.481192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.481366 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.481465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.481644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.481728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.481973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.490755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.490958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.494046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.494264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.494353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.494545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.494646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.494829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.494913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.495962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.496145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.496228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.496430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.496514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.496704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.496841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.496966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.523926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.524494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.525556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.525827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.526111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.526388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.531073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.531299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.531659 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.531800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.531933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.532205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.539678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.539955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.540179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.540490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.544441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.544722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.544974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.545118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.545249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.545377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.545504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.545641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.545777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.545915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.546044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.546171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.546298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.546424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.546560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.546816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.564917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.565183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.565768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.566571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.570280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.571157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.573908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.574192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.574825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.575124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.579277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.580297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.582946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.584114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.586591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.586881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.587158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.587434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.587719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.587816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.587988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.588126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.588359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.588690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.589019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.589301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.607661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.607943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.608206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.608493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.609329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.609622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.609893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.610154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.617341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.618694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.619043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.619315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.620417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.620698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.622677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.622948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.623225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.623504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.623778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.623896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.624178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.624488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.624773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.625065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.637095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.637368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.637646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.637923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.638209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.638517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.638798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.639088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.639371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.639653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.639890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.639973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.640190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.640271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.658142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.659674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.662038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.663498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.665367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.666858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.667088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.668514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.668731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.669008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.669293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.670286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.670569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.670851 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.677303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.678741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.678889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.680355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.682117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.682400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.682789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.683064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.683668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.683966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.684252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.684569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.692195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.692502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.692806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.693911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.694282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.694494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.700588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80103) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.700868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.701144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.701414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.701680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.702053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.702342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.702424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80104) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 30 12:36:25.702609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.702691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.702888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.702979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.703155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.703246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.703426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.703562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.703684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.703766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.703952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.704035 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.704218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80103) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.704308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.704621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.704895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.705177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.705444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.705712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.705979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80104) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 30 12:36:25.742509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfae4999c0 pid: 80103 (default app) Jun 30 12:36:25.744342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfae4999c0 pid: 80104 (default app) Jun 30 12:36:25.745974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781142f-4ae9-42d0-b6a5-e265338fca57 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:25.746267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781142f-4ae9-42d0-b6a5-e265338fca57 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:25.746546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e781142f-4ae9-42d0-b6a5-e265338fca57 None None] PATH_INFO: `/v3` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:25.750781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Thu Jun 30 12:36:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:33.570522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9f9f8-1884-4c16-af60-89f64edcc24c None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:33.571088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9f9f8-1884-4c16-af60-89f64edcc24c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:33.571088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef9f9f8-1884-4c16-af60-89f64edcc24c None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:33.575408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:36:33.580698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:33.581109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:33.581262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:33.651729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: INFO dbcounter [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] Registered counter for database keystone Jun 30 12:36:33.673316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG oslo_db.sqlalchemy.engines [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80103) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:36:33.679645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writer thread running {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:36:33.856671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG passlib.handlers.bcrypt [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80103) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 12:36:33.856995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG passlib.handlers.bcrypt [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80103) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 12:36:33.912091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:33.913723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:34.035628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 30 12:36:34.227583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9f9f8-1884-4c16-af60-89f64edcc24c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:34.301014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: INFO dbcounter [None req-8ef9f9f8-1884-4c16-af60-89f64edcc24c None None] Registered counter for database keystone Jun 30 12:36:34.320368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG oslo_db.sqlalchemy.engines [None req-8ef9f9f8-1884-4c16-af60-89f64edcc24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80104) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 30 12:36:34.326629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writer thread running {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 30 12:36:34.446650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef9f9f8-1884-4c16-af60-89f64edcc24c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:34.451023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c72b27-6c58-47e1-aa97-53c2b3686f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:34.451698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72b27-6c58-47e1-aa97-53c2b3686f7f admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:34.451989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72b27-6c58-47e1-aa97-53c2b3686f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:34.452272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c72b27-6c58-47e1-aa97-53c2b3686f7f admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:34.461391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72b27-6c58-47e1-aa97-53c2b3686f7f admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:34.513276 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90c72b27-6c58-47e1-aa97-53c2b3686f7f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 12:36:34.513558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c72b27-6c58-47e1-aa97-53c2b3686f7f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:34.524512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jun 30 12:36:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 12:36:34.530472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:34.545246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167ff4a0-f8bc-4526-99ea-0c6d81285913 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:34.549723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf6c5f0-40b9-4f06-a3f0-cc7a43858171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:34.550874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c5f0-40b9-4f06-a3f0-cc7a43858171 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:34.551167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c5f0-40b9-4f06-a3f0-cc7a43858171 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:34.551451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf6c5f0-40b9-4f06-a3f0-cc7a43858171 admin admin] PATH_INFO: `/v3/projects/164f9c2181684cbfbef84aef48504d33` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:34.552998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6c5f0-40b9-4f06-a3f0-cc7a43858171 admin admin] RBAC: Authorizing `identity:get_project(project_id=164f9c2181684cbfbef84aef48504d33)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:34.606284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING keystone.common.rbac_enforcer.enforcer [None req-cbf6c5f0-40b9-4f06-a3f0-cc7a43858171 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 30 12:36:34.606868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf6c5f0-40b9-4f06-a3f0-cc7a43858171 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:34.611280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Thu Jun 30 12:36:34 2022] GET /identity/v3/projects/164f9c2181684cbfbef84aef48504d33 => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:36.693950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814dfb-306d-4992-948a-2743a10c80be None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:36.694492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814dfb-306d-4992-948a-2743a10c80be None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:36.694492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8814dfb-306d-4992-948a-2743a10c80be None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:36.698664 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:36:36.704197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41d71f-7663-4fb6-90cc-4c48071a0dac None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:36.704661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41d71f-7663-4fb6-90cc-4c48071a0dac None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:36.704813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41d71f-7663-4fb6-90cc-4c48071a0dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:36.724114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9c41d71f-7663-4fb6-90cc-4c48071a0dac None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:36.725702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9c41d71f-7663-4fb6-90cc-4c48071a0dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:36.733626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:36 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jun 30 12:36:36.756611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814dfb-306d-4992-948a-2743a10c80be None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:36.769123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8814dfb-306d-4992-948a-2743a10c80be None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:36.773336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e69c3-c868-4442-ad32-56d559eb02bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:36.773965 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e69c3-c868-4442-ad32-56d559eb02bf admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:36.774251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e69c3-c868-4442-ad32-56d559eb02bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:36.774530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e69c3-c868-4442-ad32-56d559eb02bf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:36.782197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e69c3-c868-4442-ad32-56d559eb02bf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:36.783958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e69c3-c868-4442-ad32-56d559eb02bf admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:36.793123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Thu Jun 30 12:36:36 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:36:36.798526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41d71f-7663-4fb6-90cc-4c48071a0dac None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:36.808668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41d71f-7663-4fb6-90cc-4c48071a0dac None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:36.813098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e44006-28d1-433c-b12f-b0d8f4ee48d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:36.813974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44006-28d1-433c-b12f-b0d8f4ee48d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:36.814261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44006-28d1-433c-b12f-b0d8f4ee48d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:36.814545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e44006-28d1-433c-b12f-b0d8f4ee48d7 admin admin] PATH_INFO: `/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:36.816028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e44006-28d1-433c-b12f-b0d8f4ee48d7 admin admin] RBAC: Authorizing `identity:get_user(user_id=ae10d7aab4ac4b9b82fea4d07e2038f9)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:36.817930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e44006-28d1-433c-b12f-b0d8f4ee48d7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:36.819510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Thu Jun 30 12:36:36 2022] GET /identity/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:38.966853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb3db0-fbf4-4a8a-a52b-75cc8568ba2d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:38.967344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb3db0-fbf4-4a8a-a52b-75cc8568ba2d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:38.967344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb3db0-fbf4-4a8a-a52b-75cc8568ba2d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:38.968717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:38.974726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52796bb4-e6ff-4776-b227-bfc82ea59e59 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:38.975346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52796bb4-e6ff-4776-b227-bfc82ea59e59 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:38.975346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52796bb4-e6ff-4776-b227-bfc82ea59e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:38.978461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a34e-1555-4614-8d04-aa16066992f0 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:38.978754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a34e-1555-4614-8d04-aa16066992f0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:38.979037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d186a34e-1555-4614-8d04-aa16066992f0 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:38.980350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:36:38.985480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:38.985764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:38.986042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:38.993451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-52796bb4-e6ff-4776-b227-bfc82ea59e59 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:38.994674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-52796bb4-e6ff-4776-b227-bfc82ea59e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:39.027931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG passlib.handlers.bcrypt [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80104) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 30 12:36:39.028350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG passlib.handlers.bcrypt [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80104) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 30 12:36:39.074146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:39.075764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:39.081267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:39.104462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52796bb4-e6ff-4776-b227-bfc82ea59e59 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.129988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:39.184155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:36:39.208814 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.229572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52796bb4-e6ff-4776-b227-bfc82ea59e59 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:39.267462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:39.268120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:39.268440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:39.268727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:39.319533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5472226-b5d7-4008-9314-94a360f2a8a8 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:39.322219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:39.342148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:39.343960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:39.360472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:39.361517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:39.361801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:39.362075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:39.369446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:39.375135 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:39.387489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:39.388668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:36:39.389545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 8/14] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:36:39.395773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.461539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 7/15] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:39.467169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.518766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f453ce3-aabd-4d54-98cb-b2c25af0c541 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:39.559996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:39.561293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:39.561802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:39.562303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:39.563638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:39.564208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:39.567956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:39.574128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e89b3-122a-47b9-9b91-3beed23a73b3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:39.583246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 9/16] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:39.588887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.600510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:39.614541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:39.615349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:39.615639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:39.615925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:39.625750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:39.627197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:39.629555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:36:39.652246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:39.653165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:39.654209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:36:39.654209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:36:39.654209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:36:39.654209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:36:39.654209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 8/17] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:36:39.660147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.713636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3874d05-6879-4557-83af-e070d17051ec None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:39.751729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:39.752643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:39.752943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:39.753312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] PATH_INFO: `/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:39.755639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] RBAC: Authorizing `identity:get_user(user_id=ae10d7aab4ac4b9b82fea4d07e2038f9)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:39.757149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:39.758784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:39.764103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.770994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f254e43a-c762-4836-96f9-4e02d207f9b9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:39.816434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:39.817130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:39.817421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:39.817717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:39.818456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:39.818772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:39.820191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:39.837852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:39.875071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:39.883755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e52e35-1d15-4c7a-aefc-617b03e8714f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:39.921488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851983b-0356-4e95-aa5d-eee491213fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:39.922341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851983b-0356-4e95-aa5d-eee491213fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:39.922631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851983b-0356-4e95-aa5d-eee491213fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:39.922916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851983b-0356-4e95-aa5d-eee491213fa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:39.924151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851983b-0356-4e95-aa5d-eee491213fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:39.926989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851983b-0356-4e95-aa5d-eee491213fa1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:39.928681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:39.934777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:39.971950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:40.045426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647f7a3-eb1f-4abb-880c-7e937a037fb3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:40.082808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d776fd-6148-4ef9-a1a4-0bdb7327bf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:40.083486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d776fd-6148-4ef9-a1a4-0bdb7327bf73 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:40.083779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d776fd-6148-4ef9-a1a4-0bdb7327bf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:40.084063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d776fd-6148-4ef9-a1a4-0bdb7327bf73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:40.084984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d776fd-6148-4ef9-a1a4-0bdb7327bf73 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.domain.id=default, user.id=ae10d7aab4ac4b9b82fea4d07e2038f9) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:40.085303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d776fd-6148-4ef9-a1a4-0bdb7327bf73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:40.086789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d776fd-6148-4ef9-a1a4-0bdb7327bf73 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:40.093985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jun 30 12:36:39 2022] GET /identity/v3/role_assignments?user.id=ae10d7aab4ac4b9b82fea4d07e2038f9&scope.domain.id=default&role.id=44959a301b01424ea68b1b0a25c1321f => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:42.574499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318908-5864-4895-a276-8dda00d55b02 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.575107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318908-5864-4895-a276-8dda00d55b02 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.575107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e318908-5864-4895-a276-8dda00d55b02 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:42.576519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:42.582765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fbd60-135b-4687-9a5b-2279092a5d1f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.582765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fbd60-135b-4687-9a5b-2279092a5d1f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.583264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6fbd60-135b-4687-9a5b-2279092a5d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:42.609493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-4a6fbd60-135b-4687-9a5b-2279092a5d1f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:42.610743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4a6fbd60-135b-4687-9a5b-2279092a5d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:42.686658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93725b-7c47-4d0a-9623-ad301968127b None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.686963 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93725b-7c47-4d0a-9623-ad301968127b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.687243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec93725b-7c47-4d0a-9623-ad301968127b None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:42.688629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 13/23] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:36:42.710341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798c281-6ce5-4014-ad9d-8644dcb54461 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.710636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798c281-6ce5-4014-ad9d-8644dcb54461 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.710921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798c281-6ce5-4014-ad9d-8644dcb54461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:42.730283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 11/24] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:42.739071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1798c281-6ce5-4014-ad9d-8644dcb54461 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:42.740226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1798c281-6ce5-4014-ad9d-8644dcb54461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:42.768205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fbd60-135b-4687-9a5b-2279092a5d1f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:42.821632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:42.879841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:36:42.881762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9fa8b-19d5-4b46-8273-cc8992dbe986 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.882206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9fa8b-19d5-4b46-8273-cc8992dbe986 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.882653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d9fa8b-19d5-4b46-8273-cc8992dbe986 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:42.884061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 15/26] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:42.885298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38513f25-1549-44a5-8cea-f54ff9c87d98 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.885752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38513f25-1549-44a5-8cea-f54ff9c87d98 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.886174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38513f25-1549-44a5-8cea-f54ff9c87d98 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:42.887824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 16/27] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:42.889971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ea7c-cbb8-4a69-a82f-0e644c8f9c29 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.892212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ea7c-cbb8-4a69-a82f-0e644c8f9c29 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.893921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db7ea7c-cbb8-4a69-a82f-0e644c8f9c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:42.921444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-8db7ea7c-cbb8-4a69-a82f-0e644c8f9c29 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:42.922941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8db7ea7c-cbb8-4a69-a82f-0e644c8f9c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:42.944884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6fbd60-135b-4687-9a5b-2279092a5d1f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:42.996757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:42.997866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:42.998324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:42.999009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.000193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:43.002506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:43.006786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 17/28] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:43.008496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e9ac-de1d-4fbd-a263-4fd02cd691e4 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.009044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e9ac-de1d-4fbd-a263-4fd02cd691e4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.009536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e9ac-de1d-4fbd-a263-4fd02cd691e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.031016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bfd7e9ac-de1d-4fbd-a263-4fd02cd691e4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:43.032692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bfd7e9ac-de1d-4fbd-a263-4fd02cd691e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:43.058657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:43.117138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 18/29] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:43.118533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e9ac-de1d-4fbd-a263-4fd02cd691e4 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:43.143048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 12/30] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 30 12:36:42 2022] POST /identity/v3/roles => generated 225 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:36:43.145815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:43.257743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd7e9ac-de1d-4fbd-a263-4fd02cd691e4 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:43.302321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:43.303478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.303947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.304440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.320017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:43.328928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:43.329858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:43.330611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:36:43.333584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 19/31] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:43.335008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:43.353762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:43.359627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:43.402956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9da4457-1b47-4850-b2a0-d66ee6906813 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:43.470188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:43.471462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc058b-fba0-4ae5-aed6-b2fa3d42217e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:43.471582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.472834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.473408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.487378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:43.492313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:36:43.514647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:43.515499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:43.516295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:36:43.516295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:36:43.516295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:36:43.516295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:36:43.516536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:43.516536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.516536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.516536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.517029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:43.518322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:43.519826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 13/32] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:43.521236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:43.656939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e8882-c0d8-4079-a136-178bcac1cfae None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:43.682314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 20/33] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 30 12:36:43 2022] POST /identity/v3/roles => generated 219 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:36:43.683226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:43.737168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:43.740007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.740702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.741220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.743625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:43.744233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:43.748190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:43.778345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 14/34] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:43.784333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:43.792773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:43.851404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:43.895924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f95d78-e5b4-4e4f-ad11-552685102efc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:43.940289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4262b-633e-47ac-95ae-365b3a8764b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:43.941552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4262b-633e-47ac-95ae-365b3a8764b6 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.941946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4262b-633e-47ac-95ae-365b3a8764b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.942269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4262b-633e-47ac-95ae-365b3a8764b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.943355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4262b-633e-47ac-95ae-365b3a8764b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:43.943585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4262b-633e-47ac-95ae-365b3a8764b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:43.945858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4262b-633e-47ac-95ae-365b3a8764b6 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:43.972005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 21/35] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:43.973730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a92e9-03e8-4730-bbb6-4eaf0f93aec3 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.974036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a92e9-03e8-4730-bbb6-4eaf0f93aec3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.974325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195a92e9-03e8-4730-bbb6-4eaf0f93aec3 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.976076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 22/36] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:43.977371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a77ed-e344-4064-83c1-cdbcabdada6c None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:43.977371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a77ed-e344-4064-83c1-cdbcabdada6c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:43.977371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a77ed-e344-4064-83c1-cdbcabdada6c None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:43.978985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 23/37] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:43.983671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a77ed-e344-4064-83c1-cdbcabdada6c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:44.057220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aec1e7-0281-4900-8445-c7f9dc6d343a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:44.093275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b366cb6-2cc5-4c02-9ac1-dbfa63e4a6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:44.094169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366cb6-2cc5-4c02-9ac1-dbfa63e4a6c1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.094460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366cb6-2cc5-4c02-9ac1-dbfa63e4a6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.094746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b366cb6-2cc5-4c02-9ac1-dbfa63e4a6c1 None admin] PATH_INFO: `/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.096057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b366cb6-2cc5-4c02-9ac1-dbfa63e4a6c1 None admin] RBAC: Authorizing `identity:get_user(user_id=ae10d7aab4ac4b9b82fea4d07e2038f9)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:44.097727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b366cb6-2cc5-4c02-9ac1-dbfa63e4a6c1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:44.098766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a77ed-e344-4064-83c1-cdbcabdada6c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:44.099471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 15/38] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:43 2022] GET /identity/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9 => generated 247 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:44.100740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136b33-472b-40dd-90f2-c99ea0b4fd54 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.101036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136b33-472b-40dd-90f2-c99ea0b4fd54 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.101322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed136b33-472b-40dd-90f2-c99ea0b4fd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.118897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ed136b33-472b-40dd-90f2-c99ea0b4fd54 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:44.120507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ed136b33-472b-40dd-90f2-c99ea0b4fd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:44.139730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:44.146544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcf4714-d504-4b24-bc15-008af1beb811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:44.147510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf4714-d504-4b24-bc15-008af1beb811 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.147801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf4714-d504-4b24-bc15-008af1beb811 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.148088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf4714-d504-4b24-bc15-008af1beb811 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.148922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf4714-d504-4b24-bc15-008af1beb811 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:44.150405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcf4714-d504-4b24-bc15-008af1beb811 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:44.187581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 24/39] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:36:43 2022] POST /identity/v3/projects => generated 301 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:36:44.189003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226e9e-a340-45d6-858a-a7cdb926f9c9 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.189300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226e9e-a340-45d6-858a-a7cdb926f9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.189588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0226e9e-a340-45d6-858a-a7cdb926f9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.196064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:44.209523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 16/40] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:44.209523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed136b33-472b-40dd-90f2-c99ea0b4fd54 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:44.239850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-b0226e9e-a340-45d6-858a-a7cdb926f9c9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:44.242491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b0226e9e-a340-45d6-858a-a7cdb926f9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:44.339857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 25/41] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:44.341141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226e9e-a340-45d6-858a-a7cdb926f9c9 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:44.341853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed136b33-472b-40dd-90f2-c99ea0b4fd54 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:44.381675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:44.382479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.382767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.383054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.384266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:44.385983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:44.387816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 17/42] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:44.389782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:44.461211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:44.464653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0226e9e-a340-45d6-858a-a7cdb926f9c9 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:44.479781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:44.498834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544403a7-b6a5-4375-b35e-ee128e124128 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:44.501210 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:44.502023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.502320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.502609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.503875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:44.505360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:44.507001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 26/43] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:44.507751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:44.534127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:44.535533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.535999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.536292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.537094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:44.538481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:44.552245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 18/44] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 30 12:36:44 2022] POST /identity/v3/roles => generated 223 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:36:44.553117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:44.620815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c674ee-f8ae-47a3-9a3a-621af23fb81e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:44.663581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b80cc-b5cb-4867-93f2-699ae8c14f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:44.664513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b80cc-b5cb-4867-93f2-699ae8c14f44 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.664805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b80cc-b5cb-4867-93f2-699ae8c14f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.665284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b80cc-b5cb-4867-93f2-699ae8c14f44 None admin] PATH_INFO: `/v3/domains/default/users/ae10d7aab4ac4b9b82fea4d07e2038f9/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.667452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b80cc-b5cb-4867-93f2-699ae8c14f44 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ae10d7aab4ac4b9b82fea4d07e2038f9, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:44.669015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b80cc-b5cb-4867-93f2-699ae8c14f44 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:44.686187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 27/45] 10.222.0.20 () {58 vars in 1361 bytes} [Thu Jun 30 12:36:44 2022] PUT /identity/v3/domains/default/users/ae10d7aab4ac4b9b82fea4d07e2038f9/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:36:44.700162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453677f-b3e2-4729-847e-135168e5eb3e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:44.737969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:44.748736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e565be6-2184-4e30-9eb1-aaca83034d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:44.750765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565be6-2184-4e30-9eb1-aaca83034d82 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:44.750765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565be6-2184-4e30-9eb1-aaca83034d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:44.750765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e565be6-2184-4e30-9eb1-aaca83034d82 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:44.750765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e565be6-2184-4e30-9eb1-aaca83034d82 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:44.752227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e565be6-2184-4e30-9eb1-aaca83034d82 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:44.787362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 19/46] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:36:44 2022] POST /identity/v3/projects => generated 312 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:36:46.715509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6203a5-d0c1-4bf4-881b-b4bf1d73e54f None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:46.715985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6203a5-d0c1-4bf4-881b-b4bf1d73e54f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:46.716103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6203a5-d0c1-4bf4-881b-b4bf1d73e54f None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:46.717475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 28/47] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:46.723301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bc9bc-5bae-4447-850e-d04e7003c7c6 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:46.723713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bc9bc-5bae-4447-850e-d04e7003c7c6 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:46.724002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784bc9bc-5bae-4447-850e-d04e7003c7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:46.741479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-784bc9bc-5bae-4447-850e-d04e7003c7c6 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:46.742714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-784bc9bc-5bae-4447-850e-d04e7003c7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:46.811355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 20/48] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:46.835056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6203a5-d0c1-4bf4-881b-b4bf1d73e54f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:46.843855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d818-2da8-48c0-b694-761df190be23 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:46.844155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d818-2da8-48c0-b694-761df190be23 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:46.844486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63d818-2da8-48c0-b694-761df190be23 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:46.845866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 21/49] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:36:46.851636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd26aa-bf81-4996-b522-5115489cd611 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:46.851932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd26aa-bf81-4996-b522-5115489cd611 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:46.852216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd26aa-bf81-4996-b522-5115489cd611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:46.869282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-efdd26aa-bf81-4996-b522-5115489cd611 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:46.870493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-efdd26aa-bf81-4996-b522-5115489cd611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:46.881931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:46.939995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 22/50] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:36:46.941029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6203a5-d0c1-4bf4-881b-b4bf1d73e54f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:46.964256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd26aa-bf81-4996-b522-5115489cd611 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:46.975184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:46.975987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:46.976282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:46.976600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:46.986756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:46.994521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:46.995546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:36:46.996497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 29/51] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:36:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:47.003120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:47.009512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:47.068736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd26aa-bf81-4996-b522-5115489cd611 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:47.103396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb7639-682d-46ca-b4e0-a33d1fa15a2f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:47.104299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:47.104971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:47.105191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:47.105435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:47.105795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:47.106943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:47.108457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:47.110102 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 23/52] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:47.115573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:47.138308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:47.138980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:47.139264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:47.139541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:47.140292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:47.140640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:47.142291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:47.151078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 30/53] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:47.156500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:47.217989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a288cd5-112f-4152-b658-f35a15e2dffc None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:47.230749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:47.257631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:47.258306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:47.258604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:47.259066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:47.259940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:47.261316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cb9f1b-375f-4618-bda6-2f2831134b4c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:47.261572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:47.290179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 24/54] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jun 30 12:36:47 2022] POST /identity/v3/projects => generated 298 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:36:47.300831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:47.301716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:47.302011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:47.302297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] PATH_INFO: `/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:47.303655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] RBAC: Authorizing `identity:get_user(user_id=ae10d7aab4ac4b9b82fea4d07e2038f9)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:47.305207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:47.306945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 31/55] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:47 2022] GET /identity/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9 => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:47.312681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:47.427046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8d5ec5-4ebf-4230-958c-2015a90dc2b2 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:47.463310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f3617-8ace-4a96-813d-7b1479a586f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:47.464122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3617-8ace-4a96-813d-7b1479a586f0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:47.464468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3617-8ace-4a96-813d-7b1479a586f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:47.464764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f3617-8ace-4a96-813d-7b1479a586f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:47.465982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f3617-8ace-4a96-813d-7b1479a586f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:47.467455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f3617-8ace-4a96-813d-7b1479a586f0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:47.469202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 25/56] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:47.476044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:47.614461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:47.695960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f817acf-6ab8-425c-a459-b58c4fbd250d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:47.729660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906187d-2291-402f-9966-ac55b6dd817e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:47.730334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906187d-2291-402f-9966-ac55b6dd817e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:47.730630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906187d-2291-402f-9966-ac55b6dd817e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:47.730921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906187d-2291-402f-9966-ac55b6dd817e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:47.731825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906187d-2291-402f-9966-ac55b6dd817e None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.domain.id=default, user.id=ae10d7aab4ac4b9b82fea4d07e2038f9) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:47.732149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906187d-2291-402f-9966-ac55b6dd817e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:47.733636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906187d-2291-402f-9966-ac55b6dd817e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:47.742403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 32/57] 10.222.0.20 () {56 vars in 1322 bytes} [Thu Jun 30 12:36:47 2022] GET /identity/v3/role_assignments?user.id=ae10d7aab4ac4b9b82fea4d07e2038f9&scope.domain.id=default&role.id=44959a301b01424ea68b1b0a25c1321f => generated 530 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:49.382951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90f775-b2b5-4d7b-9a9e-bd68b63d8c99 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:49.383465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90f775-b2b5-4d7b-9a9e-bd68b63d8c99 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:49.383584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90f775-b2b5-4d7b-9a9e-bd68b63d8c99 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:49.384953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 26/58] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:49.390014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25240-0d93-491c-b457-6fa0661d77ee None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:49.390470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25240-0d93-491c-b457-6fa0661d77ee None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:49.390590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b25240-0d93-491c-b457-6fa0661d77ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:49.407329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f6b25240-0d93-491c-b457-6fa0661d77ee None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:49.408572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f6b25240-0d93-491c-b457-6fa0661d77ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:49.476297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 33/59] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:49.501204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90f775-b2b5-4d7b-9a9e-bd68b63d8c99 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:49.531118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:49.606340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90f775-b2b5-4d7b-9a9e-bd68b63d8c99 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:49.640748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af5831-f5da-4b05-8d58-0aabbff01bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:49.641472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5831-f5da-4b05-8d58-0aabbff01bda None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:49.642025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5831-f5da-4b05-8d58-0aabbff01bda None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:49.642314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af5831-f5da-4b05-8d58-0aabbff01bda None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:49.643505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af5831-f5da-4b05-8d58-0aabbff01bda None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:49.645784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af5831-f5da-4b05-8d58-0aabbff01bda None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:49.647481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 27/60] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:49.653037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25240-0d93-491c-b457-6fa0661d77ee None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:49.680971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:49.754188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b25240-0d93-491c-b457-6fa0661d77ee None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:49.788105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c620b1-3091-4264-9da1-42597398cd72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:49.788813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c620b1-3091-4264-9da1-42597398cd72 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:49.789105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c620b1-3091-4264-9da1-42597398cd72 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:49.789390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c620b1-3091-4264-9da1-42597398cd72 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:49.790115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c620b1-3091-4264-9da1-42597398cd72 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:49.791568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c620b1-3091-4264-9da1-42597398cd72 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:49.819081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 34/61] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:36:49 2022] POST /identity/v3/users => generated 275 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:36:53.078179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e688-6c21-436c-95e2-f408f09b9c91 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.079230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e688-6c21-436c-95e2-f408f09b9c91 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.079716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9e688-6c21-436c-95e2-f408f09b9c91 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.081852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 28/62] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:53.088332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba37b3e-f627-437c-ab3c-24afda8411b3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.088820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba37b3e-f627-437c-ab3c-24afda8411b3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.088932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba37b3e-f627-437c-ab3c-24afda8411b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.113862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3ba37b3e-f627-437c-ab3c-24afda8411b3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:53.115358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3ba37b3e-f627-437c-ab3c-24afda8411b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:53.211970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 35/63] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:53.257920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e688-6c21-436c-95e2-f408f09b9c91 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:53.270088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb788-0fcc-49ae-9a7b-f478be628d12 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.270382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb788-0fcc-49ae-9a7b-f478be628d12 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.270681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb788-0fcc-49ae-9a7b-f478be628d12 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.272740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 36/64] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:36:53.278120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b940bf-1369-4129-8c9f-ffe1ad23b15e None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.278927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b940bf-1369-4129-8c9f-ffe1ad23b15e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.279438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b940bf-1369-4129-8c9f-ffe1ad23b15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.300738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-97b940bf-1369-4129-8c9f-ffe1ad23b15e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:53.302367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-97b940bf-1369-4129-8c9f-ffe1ad23b15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:53.311845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:53.415948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 37/65] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:36:53.417606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b795-b479-43af-adbc-31f80d1db427 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.418046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b795-b479-43af-adbc-31f80d1db427 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.418477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b426b795-b479-43af-adbc-31f80d1db427 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.419929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 38/66] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:53.426578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83afc-fac5-4074-8088-01cd92cf80d1 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.427142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83afc-fac5-4074-8088-01cd92cf80d1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.427572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f83afc-fac5-4074-8088-01cd92cf80d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.433243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed9e688-6c21-436c-95e2-f408f09b9c91 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:53.442175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:53.447353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-c2f83afc-fac5-4074-8088-01cd92cf80d1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:53.448766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c2f83afc-fac5-4074-8088-01cd92cf80d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:53.470668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee3226e-823c-4895-9f2e-f361dd8ca622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:53.471471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3226e-823c-4895-9f2e-f361dd8ca622 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.472313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3226e-823c-4895-9f2e-f361dd8ca622 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.472653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee3226e-823c-4895-9f2e-f361dd8ca622 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.484478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee3226e-823c-4895-9f2e-f361dd8ca622 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-fee3226e-823c-4895-9f2e-f361dd8ca622 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:53.494139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:53.495038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:36:53.495794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 29/67] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:36:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:53.497005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8da7-149a-4efc-9354-1b956c09afcb None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.497005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8da7-149a-4efc-9354-1b956c09afcb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.497225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7d8da7-149a-4efc-9354-1b956c09afcb None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.498769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 30/68] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:53.499674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d8da7-149a-4efc-9354-1b956c09afcb None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:53.536584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 39/69] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:36:53.537451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83afc-fac5-4074-8088-01cd92cf80d1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:53.631525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:53.632815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7d8da7-149a-4efc-9354-1b956c09afcb None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:53.670927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f83afc-fac5-4074-8088-01cd92cf80d1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:53.685833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda40a95-af59-4761-ad86-1f84e324e9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:53.686713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40a95-af59-4761-ad86-1f84e324e9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.686942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40a95-af59-4761-ad86-1f84e324e9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.687228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda40a95-af59-4761-ad86-1f84e324e9e7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.702114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda40a95-af59-4761-ad86-1f84e324e9e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-eda40a95-af59-4761-ad86-1f84e324e9e7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:53.710460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:53.711328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:36:53.712094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 31/70] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:36:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:53.713905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:53.714586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.714877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.715160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.715921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:53.716293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:53.717713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:53.717990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3676b-97df-482c-8f7b-1be8a73b6a98 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.718291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3676b-97df-482c-8f7b-1be8a73b6a98 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.718577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b3676b-97df-482c-8f7b-1be8a73b6a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.732804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 40/71] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:53.732804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:53.736223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-84b3676b-97df-482c-8f7b-1be8a73b6a98 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:53.737990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-84b3676b-97df-482c-8f7b-1be8a73b6a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:53.750034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:53.813644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 32/72] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:53.814549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3676b-97df-482c-8f7b-1be8a73b6a98 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:53.874448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bd172-7541-4287-9a8b-7e8c4a8e2299 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:53.913397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:53.914196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.914484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.914765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.916693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:53.926903 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:53.928025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b3676b-97df-482c-8f7b-1be8a73b6a98 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:53.934578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:53.935429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:36:53.936188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 41/73] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:53.936845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:53.965840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:53.966526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:53.966823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:53.967117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:53.967882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:53.968202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:53.969662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:53.978083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 33/74] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:36:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:53.978929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:53.991635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.047087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3609c-13aa-44c1-bbf5-64e9e6dccbae None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.082045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f574e-b532-4c95-8c57-4743cff4a662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.082946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f574e-b532-4c95-8c57-4743cff4a662 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.083219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f574e-b532-4c95-8c57-4743cff4a662 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.083500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f574e-b532-4c95-8c57-4743cff4a662 None admin] PATH_INFO: `/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.084774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f574e-b532-4c95-8c57-4743cff4a662 None admin] RBAC: Authorizing `identity:get_user(user_id=ae10d7aab4ac4b9b82fea4d07e2038f9)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.086240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f574e-b532-4c95-8c57-4743cff4a662 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.087887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 42/75] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:53 2022] GET /identity/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:54.088800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6129a181-0dfe-409c-b89e-1245f15a0ef1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.089321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616512-0cf0-4014-a6a4-9aba642123db None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.089651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616512-0cf0-4014-a6a4-9aba642123db None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.089651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01616512-0cf0-4014-a6a4-9aba642123db None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.090886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 43/76] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:54.091589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01616512-0cf0-4014-a6a4-9aba642123db None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.127881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.128835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.129063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.129389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.139861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:54.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:54.149249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:36:54.150188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 34/77] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:54.151039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.161667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.207099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01616512-0cf0-4014-a6a4-9aba642123db None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.225062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.248741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.249543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.249914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.251060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.251060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:54.251310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.252669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.263433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 44/78] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:54.264340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.276257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867faee2-a893-446f-bc52-a88933a8f196 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.319514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126151a0-111e-456d-9f47-618f3dec1a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.320454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126151a0-111e-456d-9f47-618f3dec1a83 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.320761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126151a0-111e-456d-9f47-618f3dec1a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.321047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126151a0-111e-456d-9f47-618f3dec1a83 None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.336226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126151a0-111e-456d-9f47-618f3dec1a83 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.337744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126151a0-111e-456d-9f47-618f3dec1a83 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.339502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 35/79] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:54.340809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c468-0feb-47a3-9db9-de7a3330ec16 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.341079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c468-0feb-47a3-9db9-de7a3330ec16 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.341370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1139c468-0feb-47a3-9db9-de7a3330ec16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.360673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1139c468-0feb-47a3-9db9-de7a3330ec16 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:54.361918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1139c468-0feb-47a3-9db9-de7a3330ec16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:54.389931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0b7cf-38a0-41e6-aa62-97f1d90acac6 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.417004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.431340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.432004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.432294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.432609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.445842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 36/80] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:54.446952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139c468-0feb-47a3-9db9-de7a3330ec16 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.512856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.514595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.516100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.560024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1139c468-0feb-47a3-9db9-de7a3330ec16 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.594263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.594945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.595243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.595527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.596297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] RBAC: Adding query filter params (name=member) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:54.596670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.598837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.607274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 37/81] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:54.608134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.621443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 45/82] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:54.622688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.648318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.724759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daab3b6-1029-4abb-9305-b93556815999 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.725234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55eb2d-bce1-495b-9060-9b922f984198 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.742850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.761172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.761399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.761837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.762050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.762143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.762338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.762427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.762619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.763882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.765339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.767244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 38/83] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:54.768037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.833362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.834858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.860787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:54.872943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a04834-35c2-4d8d-8439-2717502247b5 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:54.907535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:54.908345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:54.908668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:54.908959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:54.910749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:54.912227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:54.913918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 39/84] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:54.914710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.944811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 46/85] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:54.945678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:54.973906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.021458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfb4d9-acec-411c-9d24-be775a3e9e1d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.055569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.056476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.056612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25844b47-9621-44da-947e-19e0e6b4caf9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.056776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.057066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.058295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.059771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.061462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 40/86] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:55.062251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:55.082014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.093696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.094562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.094854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.095128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.096329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.097864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.099598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 47/87] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:36:54 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:55.100356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:55.167099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee6d16-39c9-44a4-8718-b9f3d19473fe None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.192325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.204796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.205465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.205754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.206074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.206302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e88933f-8f16-4113-9a39-02aca314c1b5 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.242300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.242985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.243279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.243565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.244299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.245807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.268560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 48/88] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:36:55 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:36:55.269632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:55.278432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.279903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.345564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.411209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 41/89] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:55.412126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:55.430005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcff138-6120-4469-b6fc-309a080323f2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.444863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.475733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.476968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.477264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.477555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.479073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.480647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.482579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 49/90] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:36:55 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:55.483163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:55.538540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad0a00c-b53f-403d-a05f-31a1d7114916 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.585530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.586202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.586499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.586792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.610420 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb7209-1037-43e0-9ed6-fe3d0e22403f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.630910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.658647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.659879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.660345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.660667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.661542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=ae10d7aab4ac4b9b82fea4d07e2038f9) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:55.661872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.663354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.671838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 50/91] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:36:55 2022] GET /identity/v3/role_assignments?user.id=ae10d7aab4ac4b9b82fea4d07e2038f9&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:55.676639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:55.683859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.685666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.715698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.811313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 42/92] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:36:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:36:55.812622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:55.926422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb9e961-490f-426c-acc9-49671b4f4445 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.953839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:55.970164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:55.971100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:55.971530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:55.971872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b13e410-7f2a-43f1-9dd4-14324c90f01f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:55.972190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:55.973246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] RBAC: Adding query filter params (role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=b6b705ca69f04d488757f912f5f87a37) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:55.973727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:55.975601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:55.982370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 43/93] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:36:55 2022] GET /identity/v3/role_assignments?user.id=b6b705ca69f04d488757f912f5f87a37&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:55.983429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:56.033337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:56.034457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:56.034855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:56.035248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:56.041369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:56.043028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:56.045251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 51/94] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:36:55 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:56.053038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:56.160976 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5891e95-58ca-414e-8d13-d03c3f2cf601 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:56.176769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:56.228046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:56.230034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:56.230537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:56.231017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] PATH_INFO: `/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:56.235844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] RBAC: Authorizing `identity:get_project(project_id=d7963b318cdf453b8c53b53cecdcf7eb)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:56.238535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:56.240927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 44/95] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:36:55 2022] GET /identity/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb => generated 312 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:56.247218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:56.250087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa819b-d07f-4f5a-86c5-4babb4025d7b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:56.291755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a972f5-24cf-4198-978d-7a089dcda83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:56.291755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a972f5-24cf-4198-978d-7a089dcda83b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:56.291755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a972f5-24cf-4198-978d-7a089dcda83b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:56.291755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a972f5-24cf-4198-978d-7a089dcda83b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:56.292142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a972f5-24cf-4198-978d-7a089dcda83b None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=b6b705ca69f04d488757f912f5f87a37) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:56.292142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a972f5-24cf-4198-978d-7a089dcda83b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:56.292526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a972f5-24cf-4198-978d-7a089dcda83b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:56.298786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 52/96] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:36:56 2022] GET /identity/v3/role_assignments?user.id=b6b705ca69f04d488757f912f5f87a37&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:56.340818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:56.402234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c49e44c-6806-48cc-b7ca-7b43037c0738 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:56.451779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3eafb8-5ccb-4f83-88cb-d9c8a08f32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:56.452414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eafb8-5ccb-4f83-88cb-d9c8a08f32f7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:56.452899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eafb8-5ccb-4f83-88cb-d9c8a08f32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:56.453877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3eafb8-5ccb-4f83-88cb-d9c8a08f32f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:56.454190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eafb8-5ccb-4f83-88cb-d9c8a08f32f7 None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=d7963b318cdf453b8c53b53cecdcf7eb, user.id=b6b705ca69f04d488757f912f5f87a37) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:56.454522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eafb8-5ccb-4f83-88cb-d9c8a08f32f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:56.456280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3eafb8-5ccb-4f83-88cb-d9c8a08f32f7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:56.463558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 45/97] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:36:56 2022] GET /identity/v3/role_assignments?user.id=b6b705ca69f04d488757f912f5f87a37&scope.project.id=d7963b318cdf453b8c53b53cecdcf7eb&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:58.266138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870e33c-087e-459c-89ea-868b911ddb66 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.266749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870e33c-087e-459c-89ea-868b911ddb66 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.266749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8870e33c-087e-459c-89ea-868b911ddb66 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.269111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 53/98] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:58.274759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16c7c6-9fe8-4c44-af2a-1cdfe2901980 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.275228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16c7c6-9fe8-4c44-af2a-1cdfe2901980 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.275409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad16c7c6-9fe8-4c44-af2a-1cdfe2901980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.297542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ad16c7c6-9fe8-4c44-af2a-1cdfe2901980 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:58.298794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ad16c7c6-9fe8-4c44-af2a-1cdfe2901980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:58.305274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097000e-3c7e-4fbc-8667-293cec0eb0ea None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.305635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097000e-3c7e-4fbc-8667-293cec0eb0ea None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.305922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c097000e-3c7e-4fbc-8667-293cec0eb0ea None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.307459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 54/99] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:58.313255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb61708-22e4-45ce-b71b-f6b76129b876 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.313562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb61708-22e4-45ce-b71b-f6b76129b876 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.313849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb61708-22e4-45ce-b71b-f6b76129b876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.350000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-2fb61708-22e4-45ce-b71b-f6b76129b876 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:58.351354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2fb61708-22e4-45ce-b71b-f6b76129b876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:58.436643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 46/100] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:58.477330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 55/101] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:36:58.479783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16c7c6-9fe8-4c44-af2a-1cdfe2901980 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:58.511489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb61708-22e4-45ce-b71b-f6b76129b876 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:58.578551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:58.587301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:58.672893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad16c7c6-9fe8-4c44-af2a-1cdfe2901980 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:58.676648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb61708-22e4-45ce-b71b-f6b76129b876 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:58.739608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3959873f-85c2-4ffc-a59f-c013c0b5127f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:58.740443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959873f-85c2-4ffc-a59f-c013c0b5127f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.740742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959873f-85c2-4ffc-a59f-c013c0b5127f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.741032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3959873f-85c2-4ffc-a59f-c013c0b5127f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.742507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959873f-85c2-4ffc-a59f-c013c0b5127f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:58.743979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3959873f-85c2-4ffc-a59f-c013c0b5127f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:58.745813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 56/102] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:58.747138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a9e87-42af-4c07-9fb1-cb09442a34d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:58.747953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9e87-42af-4c07-9fb1-cb09442a34d1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.748245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9e87-42af-4c07-9fb1-cb09442a34d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.748554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a9e87-42af-4c07-9fb1-cb09442a34d1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.751877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a74500-3d6f-4312-9f06-debdc3461387 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.752170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a74500-3d6f-4312-9f06-debdc3461387 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.752481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a74500-3d6f-4312-9f06-debdc3461387 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.754506 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 57/103] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:58.758541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a74500-3d6f-4312-9f06-debdc3461387 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:58.767985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a9e87-42af-4c07-9fb1-cb09442a34d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-3d6a9e87-42af-4c07-9fb1-cb09442a34d1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:58.781198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:58.782140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:36:58.782925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:36:58.786157 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 47/104] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:58.787551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d4a6-d3a0-4220-bc9e-5360f8da55bd None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:58.787853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d4a6-d3a0-4220-bc9e-5360f8da55bd None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:58.788146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d1d4a6-d3a0-4220-bc9e-5360f8da55bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:58.820839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-73d1d4a6-d3a0-4220-bc9e-5360f8da55bd None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:58.822063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-73d1d4a6-d3a0-4220-bc9e-5360f8da55bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:58.950651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a74500-3d6f-4312-9f06-debdc3461387 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:58.965921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 48/105] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:58.967681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d4a6-d3a0-4220-bc9e-5360f8da55bd None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:58.980772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:59.030341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:59.031051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.031349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.031711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.032568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:59.034364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:59.057531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:59.092763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 58/106] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:36:58 2022] POST /identity/v3/projects => generated 302 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:36:59.093751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:59.137812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d1d4a6-d3a0-4220-bc9e-5360f8da55bd None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:59.189099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:59.189807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.190102 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.191547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.193657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:59.193997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:59.195468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:59.218861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 49/107] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:36:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:59.231304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:59.290644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474ae62f-b5d3-4318-93d6-d8e71babcdbe None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:59.361248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:59.366771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed44fb1e-769c-4533-95e2-d5b1c0369245 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:59.389164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:59.390159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.390548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.390930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.411440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:59.412690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.413294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.413786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] PATH_INFO: `/v3/users/f8b82f940e06432c8256162a4eedf399` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.421433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:36:59.430211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:36:59.431242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:36:59.431995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:36:59.433695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] RBAC: Authorizing `identity:get_user(user_id=f8b82f940e06432c8256162a4eedf399)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:59.435401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:59.436589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 59/108] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:36:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:36:59.437653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 50/109] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:59 2022] GET /identity/v3/users/f8b82f940e06432c8256162a4eedf399 => generated 289 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:36:59.443474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:59.444030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:59.489460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:59.567408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76929c25-ae2b-43a8-bba6-e669586981b7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:59.601176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da2c688-6394-4b5d-aba6-36531631bbbf None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:59.605762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93ab88-c167-4242-9361-4cc3e1b33e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:59.606627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ab88-c167-4242-9361-4cc3e1b33e40 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.607060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ab88-c167-4242-9361-4cc3e1b33e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.607502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93ab88-c167-4242-9361-4cc3e1b33e40 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.638696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:59.642857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa53119-9f69-4307-82ae-eb46adaa0715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:59.644219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53119-9f69-4307-82ae-eb46adaa0715 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.644651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53119-9f69-4307-82ae-eb46adaa0715 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.645748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa53119-9f69-4307-82ae-eb46adaa0715 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.646543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa53119-9f69-4307-82ae-eb46adaa0715 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:36:59.646844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa53119-9f69-4307-82ae-eb46adaa0715 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:59.648241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa53119-9f69-4307-82ae-eb46adaa0715 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:59.658144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 60/110] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:36:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:59.659615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43601a2-4e38-4001-a285-473c0e0cc754 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.660096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43601a2-4e38-4001-a285-473c0e0cc754 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.660408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43601a2-4e38-4001-a285-473c0e0cc754 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.661731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 61/111] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:59.664413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43601a2-4e38-4001-a285-473c0e0cc754 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:59.696590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ab88-c167-4242-9361-4cc3e1b33e40 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:59.699455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e93ab88-c167-4242-9361-4cc3e1b33e40 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:59.773790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:59.792059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43601a2-4e38-4001-a285-473c0e0cc754 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:36:59.816776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 51/112] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:36:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 12:36:59.818314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17af8a-b984-4cf5-8ebd-4a2f9d99ffa2 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.818803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17af8a-b984-4cf5-8ebd-4a2f9d99ffa2 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.819092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c17af8a-b984-4cf5-8ebd-4a2f9d99ffa2 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.820736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 52/113] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:59.821928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d017-0058-476d-9a0c-b5d1907b9828 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.822300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d017-0058-476d-9a0c-b5d1907b9828 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.822662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d27d017-0058-476d-9a0c-b5d1907b9828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.837767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e028581-05c2-453c-9341-925b5aeb40d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:36:59.838681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028581-05c2-453c-9341-925b5aeb40d5 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.838975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028581-05c2-453c-9341-925b5aeb40d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.839260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e028581-05c2-453c-9341-925b5aeb40d5 None admin] PATH_INFO: `/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.840471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0d27d017-0058-476d-9a0c-b5d1907b9828 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:59.840575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e028581-05c2-453c-9341-925b5aeb40d5 None admin] RBAC: Authorizing `identity:get_user(user_id=ae10d7aab4ac4b9b82fea4d07e2038f9)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:36:59.841760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0d27d017-0058-476d-9a0c-b5d1907b9828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:59.842011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e028581-05c2-453c-9341-925b5aeb40d5 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:36:59.854084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 62/114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:36:59 2022] GET /identity/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9 => generated 247 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:36:59.854084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bfe60-abd6-418a-b918-00daf5b683e8 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.854084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bfe60-abd6-418a-b918-00daf5b683e8 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.854084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64bfe60-abd6-418a-b918-00daf5b683e8 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.854084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 63/115] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:36:59.854084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85ef9-b93f-4e96-bbec-55880a5e3484 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:36:59.854566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85ef9-b93f-4e96-bbec-55880a5e3484 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:36:59.854566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd85ef9-b93f-4e96-bbec-55880a5e3484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:36:59.872556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5cd85ef9-b93f-4e96-bbec-55880a5e3484 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:36:59.873857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5cd85ef9-b93f-4e96-bbec-55880a5e3484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:36:59.908302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:36:59.925698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 53/116] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:59.926848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27d017-0058-476d-9a0c-b5d1907b9828 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:36:59.950568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 64/117] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:36:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:36:59.957827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd85ef9-b93f-4e96-bbec-55880a5e3484 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.056639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.063620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d27d017-0058-476d-9a0c-b5d1907b9828 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.076548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd85ef9-b93f-4e96-bbec-55880a5e3484 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.100557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9ee536-b057-4d7a-af46-cb18db1f4b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.101429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ee536-b057-4d7a-af46-cb18db1f4b01 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.101715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ee536-b057-4d7a-af46-cb18db1f4b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.101996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9ee536-b057-4d7a-af46-cb18db1f4b01 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.103293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ee536-b057-4d7a-af46-cb18db1f4b01 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:00.104696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9ee536-b057-4d7a-af46-cb18db1f4b01 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:00.106677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 54/118] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:36:59 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:00.107668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a2657-b1cc-4632-9b27-7759bf95bea4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.107957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a2657-b1cc-4632-9b27-7759bf95bea4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.108238 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17a2657-b1cc-4632-9b27-7759bf95bea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.119545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.120441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.120741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.121030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.122263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:00.123731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:00.125148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b17a2657-b1cc-4632-9b27-7759bf95bea4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:00.130807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 65/119] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:36:59 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:00.130807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.131037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b17a2657-b1cc-4632-9b27-7759bf95bea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:00.183866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.203221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 55/120] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:00.209596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a2657-b1cc-4632-9b27-7759bf95bea4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.236574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41860ce-07a2-4668-bec5-b88fc2c30b4d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.273029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.273835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.274126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.274414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.286977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:00.294845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:00.296086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 66/121] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:00.296894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.317528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.328764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17a2657-b1cc-4632-9b27-7759bf95bea4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.367327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.368135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.368450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.368738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.381037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:00.388841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:00.389887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:00.390717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 56/122] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:00.396622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.417273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806a9a9b-8720-44ea-b59b-8f5add47dc86 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.445505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.452441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.453116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.453413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.453702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.454547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] RBAC: Adding query filter params (role.id=2056b78da4104febafaea3f956d1fe6c, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=f8b82f940e06432c8256162a4eedf399) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:00.454872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:00.456989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:00.462907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 67/123] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/role_assignments?user.id=f8b82f940e06432c8256162a4eedf399&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=2056b78da4104febafaea3f956d1fe6c => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:00.465265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.514448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa138b5-d00f-426b-94ff-3e80f0467958 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.556718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.557941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.558227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/ae10d7aab4ac4b9b82fea4d07e2038f9/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.560575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcd177d0fc242728a0eeb05c6b14f0e, user_id=ae10d7aab4ac4b9b82fea4d07e2038f9, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:00.561695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.562093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:00.580799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 57/124] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:00 2022] PUT /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/ae10d7aab4ac4b9b82fea4d07e2038f9/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:00.583859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.621697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8f3567-3323-4013-84f3-ed094c732cb2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.676663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.678050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.678695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.679193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.697132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:00.707586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:00.708853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:00.709689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:00.712497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 68/125] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:00.713714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.756445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da17433-e877-4e8e-8403-2002376ca204 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.765053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.802456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.803617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.804107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.804633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.805659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] RBAC: Adding query filter params (name=member) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:00.805982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:00.808237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:00.819834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 58/126] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:00.820892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.835314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c9e8d-c1b2-4a4d-a367-0208f4872daa None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.872517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.873211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.873507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.873794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.874564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:00.874882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:00.876285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:00.878437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:00.887394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 69/127] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:00.888261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:00.938624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926cc3c5-424a-46c7-9316-8a8e8e46db57 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:00.978214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:00.978996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:00.979287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:00.979571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:00.980337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:00.980684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:00.982413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:00.992201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 59/128] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:00.993460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.001824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c253cd61-b04c-46d7-b9cc-a2061a81a5b1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.028072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:01.039699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.040628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.040923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.041212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.042486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.044031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.045740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 70/129] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:01.046543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.110454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a09b9b-3fc7-4f3b-afff-2cdc93d007ce None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.114195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:01.151885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.152929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.153224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.153510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.155086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.156816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.158882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 60/130] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:00 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:01.159907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.165398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a9d533-ea32-4139-b181-7e886d3a6b7e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.203334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.204237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.204557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.204846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.206802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.208367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.210083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 71/131] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:01 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:01.211003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.273088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:01.277620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37aff23-08ee-4cd6-8e7f-58ac45681b24 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.317585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.318902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.319411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.319902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] PATH_INFO: `/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.321216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212964cc-06e8-4248-a1d4-37435fc2165f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.321957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] RBAC: Authorizing `identity:get_project(project_id=d7963b318cdf453b8c53b53cecdcf7eb)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.323822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.325906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 61/132] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:01 2022] GET /identity/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:01.327121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.354496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:01.359479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.360368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.360870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.361217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.363148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.365327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.367478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 72/133] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:01 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:01.368600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.448302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1be5a8-e0a0-4d27-960f-95bbbf2eb637 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.479775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d13e0-8639-4ff4-91f5-32e1d84c410f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.488596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.489705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.490134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.490654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.492211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.493909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.496289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 62/134] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:01 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:01.497353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.517970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.519355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.519624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.520090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] PATH_INFO: `/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb/users/b6b705ca69f04d488757f912f5f87a37/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.522148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] RBAC: Authorizing `identity:create_grant(project_id=d7963b318cdf453b8c53b53cecdcf7eb, user_id=b6b705ca69f04d488757f912f5f87a37, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.523984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.539005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:01.545053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 73/135] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:01 2022] PUT /identity/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb/users/b6b705ca69f04d488757f912f5f87a37/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:01.546182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:01.632178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:01.682295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2883d-f5d1-4b38-90cf-444ca9b4f64f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.687483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3d013c-8ff5-4a6b-b036-62c11e6feebb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:01.732322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf098f3-5b67-4147-9a69-48e0a2428050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.733410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf098f3-5b67-4147-9a69-48e0a2428050 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.734373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf098f3-5b67-4147-9a69-48e0a2428050 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.734755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf098f3-5b67-4147-9a69-48e0a2428050 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/b6b705ca69f04d488757f912f5f87a37/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.737589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf098f3-5b67-4147-9a69-48e0a2428050 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcd177d0fc242728a0eeb05c6b14f0e, user_id=b6b705ca69f04d488757f912f5f87a37, role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.739737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf098f3-5b67-4147-9a69-48e0a2428050 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.764780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c15b0b-9010-4510-b4b7-768c67ab5072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:01.766138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c15b0b-9010-4510-b4b7-768c67ab5072 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.766511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 74/136] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:01 2022] PUT /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/b6b705ca69f04d488757f912f5f87a37/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:01.767175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c15b0b-9010-4510-b4b7-768c67ab5072 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.767681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c15b0b-9010-4510-b4b7-768c67ab5072 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/b6b705ca69f04d488757f912f5f87a37/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.774711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c15b0b-9010-4510-b4b7-768c67ab5072 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcd177d0fc242728a0eeb05c6b14f0e, user_id=b6b705ca69f04d488757f912f5f87a37, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:01.776826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c15b0b-9010-4510-b4b7-768c67ab5072 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:01.804048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 63/137] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:01 2022] PUT /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/b6b705ca69f04d488757f912f5f87a37/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:01.916288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba930e-618c-42f7-bd9f-1c4c10f6b8c1 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.916610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba930e-618c-42f7-bd9f-1c4c10f6b8c1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.916813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba930e-618c-42f7-bd9f-1c4c10f6b8c1 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.918596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 75/138] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:01.932070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2ced-8d17-4487-80d7-31d6d2ee1621 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:01.932377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2ced-8d17-4487-80d7-31d6d2ee1621 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:01.932676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb2ced-8d17-4487-80d7-31d6d2ee1621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:01.955708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-33cb2ced-8d17-4487-80d7-31d6d2ee1621 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:01.957644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-33cb2ced-8d17-4487-80d7-31d6d2ee1621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:02.048995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 64/139] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:02.081601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba930e-618c-42f7-bd9f-1c4c10f6b8c1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:02.217630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba930e-618c-42f7-bd9f-1c4c10f6b8c1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:02.242111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:02.258127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66f859b-22b7-4f26-a2d8-ce6f1367003d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:02.258995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f859b-22b7-4f26-a2d8-ce6f1367003d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:02.259720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f859b-22b7-4f26-a2d8-ce6f1367003d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:02.260368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66f859b-22b7-4f26-a2d8-ce6f1367003d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:02.266021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f859b-22b7-4f26-a2d8-ce6f1367003d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:02.267824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66f859b-22b7-4f26-a2d8-ce6f1367003d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:02.270294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 76/140] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:02.275486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb2ced-8d17-4487-80d7-31d6d2ee1621 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:02.308750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:02.410898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb2ced-8d17-4487-80d7-31d6d2ee1621 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:02.474523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96e9339-2f11-4bee-9e0b-b5e4dc67f7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:02.475401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9339-2f11-4bee-9e0b-b5e4dc67f7b3 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:02.475709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9339-2f11-4bee-9e0b-b5e4dc67f7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:02.476001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96e9339-2f11-4bee-9e0b-b5e4dc67f7b3 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:02.477030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9339-2f11-4bee-9e0b-b5e4dc67f7b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:02.478708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96e9339-2f11-4bee-9e0b-b5e4dc67f7b3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:02.515188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 65/141] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:02 2022] POST /identity/v3/users => generated 283 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:03.369992 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba8fb-4fe1-4c20-aede-d128f8088a0d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:03.370521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba8fb-4fe1-4c20-aede-d128f8088a0d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:03.370603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcba8fb-4fe1-4c20-aede-d128f8088a0d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:03.372002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 77/142] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:03.379439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e827cc-166a-497f-966f-28f22a116bce None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:03.379843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e827cc-166a-497f-966f-28f22a116bce None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:03.380209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e827cc-166a-497f-966f-28f22a116bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:03.401669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-03e827cc-166a-497f-966f-28f22a116bce None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:03.402930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-03e827cc-166a-497f-966f-28f22a116bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:03.489869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 66/143] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:03.525416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcba8fb-4fe1-4c20-aede-d128f8088a0d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:03.646538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcba8fb-4fe1-4c20-aede-d128f8088a0d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:03.683939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7c6dbd-ad76-40e4-a714-b43db7bec376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:03.684784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6dbd-ad76-40e4-a714-b43db7bec376 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:03.685083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6dbd-ad76-40e4-a714-b43db7bec376 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:03.685372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7c6dbd-ad76-40e4-a714-b43db7bec376 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:03.698527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7c6dbd-ad76-40e4-a714-b43db7bec376 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-ae7c6dbd-ad76-40e4-a714-b43db7bec376 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:03.710595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:03.711500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:03.712725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 78/144] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:03.718221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e827cc-166a-497f-966f-28f22a116bce None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:03.734511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:03.781452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25913c8-e4ff-4025-907f-6f381d620cb9 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:03.782085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25913c8-e4ff-4025-907f-6f381d620cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:03.782584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25913c8-e4ff-4025-907f-6f381d620cb9 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:03.784745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 79/145] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:03.791328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9d2a-45a9-4392-a294-4f6ee30c0847 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:03.791924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9d2a-45a9-4392-a294-4f6ee30c0847 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:03.792440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b9d2a-45a9-4392-a294-4f6ee30c0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:03.812122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-300b9d2a-45a9-4392-a294-4f6ee30c0847 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:03.813778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-300b9d2a-45a9-4392-a294-4f6ee30c0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:03.866375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:03.870297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e827cc-166a-497f-966f-28f22a116bce None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:03.894069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 80/146] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:03.919474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9d2a-45a9-4392-a294-4f6ee30c0847 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:03.943050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:03.943747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:03.944045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:03.944339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:03.949435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:03.949749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:03.951531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:03.964248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 67/147] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:03.970143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:04.042157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b9d2a-45a9-4392-a294-4f6ee30c0847 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:04.082261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:04.083231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:04.083570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:04.083857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:04.095134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:04.103916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:04.104865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:04.106082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 81/148] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:04.111503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:04.155891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:04.174246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:04.237451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f997beea-0b83-4b97-a7f4-0ca02c836770 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:04.242346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cdd3c-303b-4b78-aa76-58ea55013d5e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:04.286650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:04.288582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:04.289492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:04.290621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:04.291457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:04.292436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:04.293482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:04.293939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:04.295571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:04.296001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:04.296460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] PATH_INFO: `/v3/users/f8b82f940e06432c8256162a4eedf399` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:04.300142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] RBAC: Authorizing `identity:get_user(user_id=f8b82f940e06432c8256162a4eedf399)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:04.301821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:04.307060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 68/149] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:03 2022] GET /identity/v3/users/f8b82f940e06432c8256162a4eedf399 => generated 289 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:04.313882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:04.314681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 82/150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:04.323828 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:04.438984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c712c9-6551-451c-9e44-cfa58831651b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:04.453221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:04.483312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:04.484506 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:04.484929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:04.485345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] PATH_INFO: `/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:04.486872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] RBAC: Authorizing `identity:get_user(user_id=ae10d7aab4ac4b9b82fea4d07e2038f9)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:04.489255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:04.491129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 83/151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:04 2022] GET /identity/v3/users/ae10d7aab4ac4b9b82fea4d07e2038f9 => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:04.491933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e2de1e-e52c-4546-a8d0-800b8f72a9e7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:04.498544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:04.559354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:04.560323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:04.560708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:04.561056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:04.565763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:04.567619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:04.569325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 69/152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:04 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:04.574980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:04.599355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:04.620905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fea384-a396-40b8-bf41-d14b847f7154 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:04.674099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:04.675878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:04.676352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:04.676831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:04.734281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:04.780414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e4d07d-7634-42a0-ad03-997b62938d6a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:04.787494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:04.789032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:04.832901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:04.834156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:04.834658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:04.835123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/f8b82f940e06432c8256162a4eedf399/roles/2056b78da4104febafaea3f956d1fe6c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:04.837499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcd177d0fc242728a0eeb05c6b14f0e, user_id=f8b82f940e06432c8256162a4eedf399, role_id=2056b78da4104febafaea3f956d1fe6c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:04.839171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:04.862727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 70/153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:04 2022] PUT /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/users/f8b82f940e06432c8256162a4eedf399/roles/2056b78da4104febafaea3f956d1fe6c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:37:04.954071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 84/154] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:04.960782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:05.045831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:05.087265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f23924b-637c-4104-8436-c69bc964ef03 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:05.124693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d54fe4-c9f6-4541-9aee-dbb4af37dc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:05.125644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54fe4-c9f6-4541-9aee-dbb4af37dc6a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:05.125985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54fe4-c9f6-4541-9aee-dbb4af37dc6a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:05.126271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d54fe4-c9f6-4541-9aee-dbb4af37dc6a None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:05.127596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d54fe4-c9f6-4541-9aee-dbb4af37dc6a None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:05.129218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d54fe4-c9f6-4541-9aee-dbb4af37dc6a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:05.131168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 71/155] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:04 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:05.136984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:05.239249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:05.278472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c48b5fa-332c-4692-8c1b-0d9cadb282b9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:05.316438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0ebec-d55e-43a8-9da1-b1ef78bc7b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:05.317148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0ebec-d55e-43a8-9da1-b1ef78bc7b2d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:05.317571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0ebec-d55e-43a8-9da1-b1ef78bc7b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:05.317856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0ebec-d55e-43a8-9da1-b1ef78bc7b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:05.318776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0ebec-d55e-43a8-9da1-b1ef78bc7b2d None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=ae10d7aab4ac4b9b82fea4d07e2038f9) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:05.319100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0ebec-d55e-43a8-9da1-b1ef78bc7b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:05.320641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0ebec-d55e-43a8-9da1-b1ef78bc7b2d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:05.327536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 85/156] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:05 2022] GET /identity/v3/role_assignments?user.id=ae10d7aab4ac4b9b82fea4d07e2038f9&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:05.546531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21d25e-76db-47ff-adb2-822ad82e4d43 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:05.547025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21d25e-76db-47ff-adb2-822ad82e4d43 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:05.547025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21d25e-76db-47ff-adb2-822ad82e4d43 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:05.548485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 72/157] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:05.554870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c893f2-d40b-4c57-ab5f-f5dc58789642 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:05.555391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c893f2-d40b-4c57-ab5f-f5dc58789642 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:05.555467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c893f2-d40b-4c57-ab5f-f5dc58789642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:05.581395 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-b4c893f2-d40b-4c57-ab5f-f5dc58789642 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:05.582896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b4c893f2-d40b-4c57-ab5f-f5dc58789642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:05.680189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 86/158] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:05.717893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21d25e-76db-47ff-adb2-822ad82e4d43 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:05.798920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8253a-fd97-42f7-aefb-7df580692aab None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:05.799122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8253a-fd97-42f7-aefb-7df580692aab None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:05.799405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f8253a-fd97-42f7-aefb-7df580692aab None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:05.801413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 87/159] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:05.807136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe609-0916-4e6c-ab75-ea7a8bfe8a4a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:05.807424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe609-0916-4e6c-ab75-ea7a8bfe8a4a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:05.807708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30fe609-0916-4e6c-ab75-ea7a8bfe8a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:05.836229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f30fe609-0916-4e6c-ab75-ea7a8bfe8a4a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:05.837615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f30fe609-0916-4e6c-ab75-ea7a8bfe8a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:05.871710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21d25e-76db-47ff-adb2-822ad82e4d43 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:05.945185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:05.946435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:05.946869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:05.947367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:05.947807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:05.962775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:05.975400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 88/160] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:05.976129 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:05.984193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:05.985346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:05.986287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:05.993678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 73/161] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:05.999949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe609-0916-4e6c-ab75-ea7a8bfe8a4a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:06.028126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:06.227469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30fe609-0916-4e6c-ab75-ea7a8bfe8a4a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:06.239979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba15fd6-0998-4c30-a5ad-789b336fb201 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:06.299265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88f8cd-1e95-4941-baf2-8c98163c9f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:06.300344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88f8cd-1e95-4941-baf2-8c98163c9f68 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:06.300703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88f8cd-1e95-4941-baf2-8c98163c9f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:06.300990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88f8cd-1e95-4941-baf2-8c98163c9f68 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:06.301754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88f8cd-1e95-4941-baf2-8c98163c9f68 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:06.302072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88f8cd-1e95-4941-baf2-8c98163c9f68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:06.303488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88f8cd-1e95-4941-baf2-8c98163c9f68 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:06.311419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db03720-8d4d-4c9b-8c85-2a262ebd38a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:06.312244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db03720-8d4d-4c9b-8c85-2a262ebd38a8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:06.312564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db03720-8d4d-4c9b-8c85-2a262ebd38a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:06.312845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db03720-8d4d-4c9b-8c85-2a262ebd38a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:06.319526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 89/162] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:06.320960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a69c1-5a7b-43d5-a5f7-bea3db8faa6b None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:06.321282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a69c1-5a7b-43d5-a5f7-bea3db8faa6b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:06.321529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a69c1-5a7b-43d5-a5f7-bea3db8faa6b None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:06.322791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 90/163] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:06.331389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a69c1-5a7b-43d5-a5f7-bea3db8faa6b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:06.340524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db03720-8d4d-4c9b-8c85-2a262ebd38a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-9db03720-8d4d-4c9b-8c85-2a262ebd38a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:06.349468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:06.350403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:06.351181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 74/164] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:06.352648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942fad7-d890-4286-ad9f-a2964e35f019 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:06.352648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942fad7-d890-4286-ad9f-a2964e35f019 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:06.357124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942fad7-d890-4286-ad9f-a2964e35f019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:06.391823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5942fad7-d890-4286-ad9f-a2964e35f019 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:06.393903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5942fad7-d890-4286-ad9f-a2964e35f019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:06.445077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:06.479385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:06.504232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 75/165] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:06.505283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942fad7-d890-4286-ad9f-a2964e35f019 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:06.537100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a69c1-5a7b-43d5-a5f7-bea3db8faa6b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:06.612311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:06.613914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:06.614555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:06.615839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:06.620010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:06.621670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:06.623672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 91/166] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:06 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:06.629377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:06.720910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942fad7-d890-4286-ad9f-a2964e35f019 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:06.794585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:06.795184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:06.795469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:06.795748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:06.796728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:06.797051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:06.798513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:06.816777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 76/167] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:06.817645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:06.818677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9074a6b8-03ca-41cf-9a07-a2c6c2b04308 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:06.844501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:06.859767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:06.860909 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:06.861369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:06.861817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:06.875279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:06.884546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:06.885443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:06.886354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:06.888717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 92/168] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:06.889804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:06.929969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:07.008868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9aa90-ef66-4592-9850-3192ebb21f8d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:07.048065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:07.049200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.049857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.050763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.052147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:07.053924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:07.055718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 93/169] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:06 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:07.056651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:07.082631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d6fa8-8188-4e0d-9c9c-0a31eb45c1b7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:07.115521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:07.175868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:07.176239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.176553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.176836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.177149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4f944-e05a-4708-bdc7-23b2e5caafff None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:07.260878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:07.261943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.262427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.262901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.263858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:07.264439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:07.266437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:07.279443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 94/170] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:07.280783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:07.281552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:07.285260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:07.426935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:07.436806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b44b80d-8152-4301-a30a-222b5535fa48 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:07.461817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:07.511437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458ea2df-895b-4b5c-9f71-c338e03bf543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:07.512705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea2df-895b-4b5c-9f71-c338e03bf543 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.513257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea2df-895b-4b5c-9f71-c338e03bf543 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.513731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458ea2df-895b-4b5c-9f71-c338e03bf543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.550915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 77/171] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 733 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:07.551474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:07.656657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea2df-895b-4b5c-9f71-c338e03bf543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:07.658112 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458ea2df-895b-4b5c-9f71-c338e03bf543 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:07.693239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115fc6e6-f519-4294-8ccd-a6ba7110dba0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:07.737512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:07.738793 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.739088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.739691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] PATH_INFO: `/v3/users/b6b705ca69f04d488757f912f5f87a37` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.741179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b705ca69f04d488757f912f5f87a37)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:07.743206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:07.745357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 78/172] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:07 2022] GET /identity/v3/users/b6b705ca69f04d488757f912f5f87a37 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:07.746147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:07.769189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:07.775111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 95/173] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:07.777098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed21c4-1c57-49ea-b3c3-3425e3fb6c6a None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.777452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed21c4-1c57-49ea-b3c3-3425e3fb6c6a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.777736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed21c4-1c57-49ea-b3c3-3425e3fb6c6a None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.783468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 96/174] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:07.786350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8599e-6fe1-4ba8-85b8-7de7dd22ba7e None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.786711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8599e-6fe1-4ba8-85b8-7de7dd22ba7e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.787299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d8599e-6fe1-4ba8-85b8-7de7dd22ba7e None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.788816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 97/175] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:07.793565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8599e-6fe1-4ba8-85b8-7de7dd22ba7e None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:07.824820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:07.871974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04050d3a-5da8-4e3d-a881-7b230b8dd581 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:07.908342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:07.909809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.910277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.910624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] PATH_INFO: `/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:07.912101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] RBAC: Authorizing `identity:get_project(project_id=d7963b318cdf453b8c53b53cecdcf7eb)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:07.912936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d8599e-6fe1-4ba8-85b8-7de7dd22ba7e None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:07.913751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:07.920490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 79/176] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:07 2022] GET /identity/v3/projects/d7963b318cdf453b8c53b53cecdcf7eb => generated 312 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:07.921673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:07.951555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73547c9d-b02a-47a6-a0b3-f9a17d457078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:07.952131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547c9d-b02a-47a6-a0b3-f9a17d457078 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:07.952443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547c9d-b02a-47a6-a0b3-f9a17d457078 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:07.952733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73547c9d-b02a-47a6-a0b3-f9a17d457078 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.019056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.030161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73547c9d-b02a-47a6-a0b3-f9a17d457078 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:08.031750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73547c9d-b02a-47a6-a0b3-f9a17d457078 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:08.038667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca58c55-e6b2-4d60-8a02-cdf32396f81e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.047971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.076502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df50e4-ba8f-44e6-8b10-2dfb92a28624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.077728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df50e4-ba8f-44e6-8b10-2dfb92a28624 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.078019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df50e4-ba8f-44e6-8b10-2dfb92a28624 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.078296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df50e4-ba8f-44e6-8b10-2dfb92a28624 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.079806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df50e4-ba8f-44e6-8b10-2dfb92a28624 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:08.081823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df50e4-ba8f-44e6-8b10-2dfb92a28624 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:08.083923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 80/177] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:07 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:08.086803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930719a-9cc2-4c05-a7a5-f659dbf3f50a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.087086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930719a-9cc2-4c05-a7a5-f659dbf3f50a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.087361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930719a-9cc2-4c05-a7a5-f659dbf3f50a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.104540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b930719a-9cc2-4c05-a7a5-f659dbf3f50a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:08.105750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b930719a-9cc2-4c05-a7a5-f659dbf3f50a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:08.155085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 98/178] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:08.155085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9b7ad-fb95-4c3c-900d-7b9722bdacec None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.155085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9b7ad-fb95-4c3c-900d-7b9722bdacec None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.155085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b9b7ad-fb95-4c3c-900d-7b9722bdacec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.170197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-69b9b7ad-fb95-4c3c-900d-7b9722bdacec None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:08.171395 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-69b9b7ad-fb95-4c3c-900d-7b9722bdacec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:08.186865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 81/179] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:08.193809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e566b62-2c31-4df4-a850-252efe4e306c None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.199452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e566b62-2c31-4df4-a850-252efe4e306c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.199452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e566b62-2c31-4df4-a850-252efe4e306c None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.199452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 82/180] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:08.199452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e566b62-2c31-4df4-a850-252efe4e306c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.260911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 99/181] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:08.272549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9b7ad-fb95-4c3c-900d-7b9722bdacec None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.308210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.317493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.331035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e566b62-2c31-4df4-a850-252efe4e306c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.367917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.368632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.368924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.369207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.370068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=d7963b318cdf453b8c53b53cecdcf7eb, user.id=b6b705ca69f04d488757f912f5f87a37) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:08.370387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:08.371839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:08.377159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b9b7ad-fb95-4c3c-900d-7b9722bdacec None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.378161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 83/182] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/role_assignments?user.id=b6b705ca69f04d488757f912f5f87a37&scope.project.id=d7963b318cdf453b8c53b53cecdcf7eb&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:08.380317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.421212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b557bd8-d0cd-4954-bc69-35681f1f7f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.422367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557bd8-d0cd-4954-bc69-35681f1f7f3a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.422367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557bd8-d0cd-4954-bc69-35681f1f7f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.422549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b557bd8-d0cd-4954-bc69-35681f1f7f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.423289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b557bd8-d0cd-4954-bc69-35681f1f7f3a None admin] RBAC: Adding query filter params (role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=b6b705ca69f04d488757f912f5f87a37) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:08.423614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b557bd8-d0cd-4954-bc69-35681f1f7f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:08.425345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b557bd8-d0cd-4954-bc69-35681f1f7f3a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:08.432271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 100/183] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/role_assignments?user.id=b6b705ca69f04d488757f912f5f87a37&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:08.433449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b52dd-8eb6-46a6-8aa4-134ff4721016 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.433745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b52dd-8eb6-46a6-8aa4-134ff4721016 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.434028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b52dd-8eb6-46a6-8aa4-134ff4721016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.467575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3d0b52dd-8eb6-46a6-8aa4-134ff4721016 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:08.469304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3d0b52dd-8eb6-46a6-8aa4-134ff4721016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:08.505695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0718e14-1e96-4237-a4ea-a8292e17d063 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.551453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.552757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.553262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.553729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.555265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:08.557817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:08.560170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 84/184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:08.561006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 101/185] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:08.561533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.561958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b52dd-8eb6-46a6-8aa4-134ff4721016 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.585541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.610106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.693685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b52dd-8eb6-46a6-8aa4-134ff4721016 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.722644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c6b2b4-b9c1-425a-9029-30d309b9d793 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.735939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f12892-022f-4a29-981f-6b360daee429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.736784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12892-022f-4a29-981f-6b360daee429 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.737594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12892-022f-4a29-981f-6b360daee429 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.737871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f12892-022f-4a29-981f-6b360daee429 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.748345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f12892-022f-4a29-981f-6b360daee429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-09f12892-022f-4a29-981f-6b360daee429 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:08.756749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:08.757811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:08.758642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 102/186] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:08.759285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447bb1-c74c-49c3-af45-320247071017 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.759529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447bb1-c74c-49c3-af45-320247071017 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.759810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88447bb1-c74c-49c3-af45-320247071017 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.760602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.761104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 103/187] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:08.761411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.761701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.761864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88447bb1-c74c-49c3-af45-320247071017 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.762039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.767357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:08.767357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:08.767587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 85/188] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:08.768344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.852085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.864580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:08.871529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0ec3bf-3907-46cd-8cba-168245deb032 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.871945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88447bb1-c74c-49c3-af45-320247071017 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:08.908746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bb3661-1383-4f8b-9fe5-fe3f4899d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.909574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb3661-1383-4f8b-9fe5-fe3f4899d941 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.910122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb3661-1383-4f8b-9fe5-fe3f4899d941 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.910402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bb3661-1383-4f8b-9fe5-fe3f4899d941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.911453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:08.912111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.912434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.912719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.913559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=b6b705ca69f04d488757f912f5f87a37) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:08.913873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:08.915323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:08.920961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bb3661-1383-4f8b-9fe5-fe3f4899d941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:08.921239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 104/189] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/role_assignments?user.id=b6b705ca69f04d488757f912f5f87a37&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:08.932923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-76bb3661-1383-4f8b-9fe5-fe3f4899d941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:08.933011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:08.933829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 86/190] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:08.935213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528612-f4ff-46e7-b449-4f5ec835a47b None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:08.937545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528612-f4ff-46e7-b449-4f5ec835a47b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:08.937545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528612-f4ff-46e7-b449-4f5ec835a47b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:08.956448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-cb528612-f4ff-46e7-b449-4f5ec835a47b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:08.957718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cb528612-f4ff-46e7-b449-4f5ec835a47b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:09.037711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 87/191] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:09.038587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528612-f4ff-46e7-b449-4f5ec835a47b None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.059093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18b0c0-cc8f-4d22-b8ac-062064bf5734 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.105976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.106457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.106749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.107049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.107859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:09.108554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.109613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.119258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 105/192] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:09.124952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.133985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:09.154149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:09.169612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528612-f4ff-46e7-b449-4f5ec835a47b None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.203788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.204484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.204771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.205048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.206327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.207839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.228144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 88/193] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:09 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:09.237638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.246706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe542bb-c8e4-4348-b5bd-e2f6d7ba3dcd None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.288770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.289465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.289756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.290036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.291463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:09.291463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.297168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.309041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 106/194] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:09.309041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.377365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe3d971-9a18-4b37-8100-1888a04c2317 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.409903 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:09.413996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:09.426379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.427194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.427484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.427769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.429094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01e5b11-803d-48b6-9c50-f058beef1113 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.441561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:09.451918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:09.452885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 89/195] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:09.457507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.477501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.478514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.478875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.479226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] PATH_INFO: `/v3/users/14e290fbe22748d09645d53ce3ebb020` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.500637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] RBAC: Authorizing `identity:get_user(user_id=14e290fbe22748d09645d53ce3ebb020)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.502110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.504118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 107/196] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:09 2022] GET /identity/v3/users/14e290fbe22748d09645d53ce3ebb020 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:09.504722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.595217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86d6554-ef6e-42a2-96b2-4d38a91475c9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.621096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0cf6d1-c098-4d8f-a228-c190660ab3a9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.641569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.642727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.643011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.643843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] PATH_INFO: `/v3/users/14e290fbe22748d09645d53ce3ebb020` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.647103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] RBAC: Authorizing `identity:get_user(user_id=14e290fbe22748d09645d53ce3ebb020)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.649255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.651899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 90/197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:09 2022] GET /identity/v3/users/14e290fbe22748d09645d53ce3ebb020 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:09.652830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.662831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.663726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.664164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.664780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.665551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:09.665864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.667250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.682532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 108/198] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:09.683434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:09.688641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:09.733434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:09.789224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc765788-ffe6-4d1f-9bcc-649dec68a2e5 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.817240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ef5fd-7b87-47c1-a2a8-3b948cac14f7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:09.826169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.826990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.827683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.827683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.863067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:09.863901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:09.864290 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:09.864765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:09.920208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.922600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.944291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:09.945723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:09.949666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.000521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.058904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 109/199] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:10.060106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:10.071816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 91/200] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:10.073045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:10.184326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1cc03b-b4c4-4359-9459-69fecc845df7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:10.188183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.192798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc3010-a5c0-4aae-a8b8-f317f5cc481a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:10.228783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:10.229835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:10.230238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:10.230620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] PATH_INFO: `/v3/users/f8b82f940e06432c8256162a4eedf399` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:10.231975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] RBAC: Authorizing `identity:get_user(user_id=f8b82f940e06432c8256162a4eedf399)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:10.233562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:10.235198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:10.235761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 110/201] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/users/f8b82f940e06432c8256162a4eedf399 => generated 289 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:10.236410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:10.237394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:10.237517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:10.238219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:10.239620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:10.241615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:10.244552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 92/202] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:10.245474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:10.280708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.355367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2aa28f-a745-4910-a07e-b75865a019ee None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:10.374961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b204f79b-f287-4207-9bad-22c63b24d770 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:10.402912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:10.404457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:10.405168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:10.405598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:10.407457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:10.409909 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:10.412064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 111/203] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:10.412369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:10.413218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:10.417687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:10.418067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:10.418450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:10.493183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.497596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:10.499121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:10.528039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.555821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe621e-d08b-4ec9-9142-12e8223ae564 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:10.603929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:10.605390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:10.605962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:10.606424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:10.607626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] RBAC: Adding query filter params (role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=14e290fbe22748d09645d53ce3ebb020) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:10.608157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:10.610504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:10.617741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 112/204] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/role_assignments?user.id=14e290fbe22748d09645d53ce3ebb020&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:10.619567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:10.639857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 93/205] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:10.646597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:10.739947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec376287-7d7f-4f87-b06b-3300fb52b536 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:10.749234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.780753 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:10.781385 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:10.781678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:10.781965 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:10.782807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=14e290fbe22748d09645d53ce3ebb020) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:10.783122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:10.786029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:10.792157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 113/206] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/role_assignments?user.id=14e290fbe22748d09645d53ce3ebb020&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:10.850561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e457cda3-0b5b-4a16-bff8-5e2448478793 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:10.897743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:10.910954 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b10303-ddac-42b1-bf7d-63d537ac5a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:10.913138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10303-ddac-42b1-bf7d-63d537ac5a3d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:10.913760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10303-ddac-42b1-bf7d-63d537ac5a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:10.914249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b10303-ddac-42b1-bf7d-63d537ac5a3d None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:10.915885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b10303-ddac-42b1-bf7d-63d537ac5a3d None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:10.917647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b10303-ddac-42b1-bf7d-63d537ac5a3d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:10.920376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 94/207] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:10.927605 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:11.069806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d910c55-6c2a-4de8-adc4-34e56c266ffb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:11.107086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1991aa55-a47f-49f1-9fd4-92b36371c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:11.107753 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991aa55-a47f-49f1-9fd4-92b36371c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:11.108046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991aa55-a47f-49f1-9fd4-92b36371c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:11.108323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1991aa55-a47f-49f1-9fd4-92b36371c6f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:11.109198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991aa55-a47f-49f1-9fd4-92b36371c6f9 None admin] RBAC: Adding query filter params (role.id=2056b78da4104febafaea3f956d1fe6c, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e, user.id=f8b82f940e06432c8256162a4eedf399) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:11.109510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991aa55-a47f-49f1-9fd4-92b36371c6f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:11.110970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1991aa55-a47f-49f1-9fd4-92b36371c6f9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:11.119024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 114/208] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:10 2022] GET /identity/v3/role_assignments?user.id=f8b82f940e06432c8256162a4eedf399&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=2056b78da4104febafaea3f956d1fe6c => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:11.539976 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbffb4e-4118-4fa1-8627-3080a70e9bc0 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:11.540716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbffb4e-4118-4fa1-8627-3080a70e9bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:11.541213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbffb4e-4118-4fa1-8627-3080a70e9bc0 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:11.543648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 95/209] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:11.551547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169d02-3f56-47b5-90dd-88eb4794525c None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:11.551876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169d02-3f56-47b5-90dd-88eb4794525c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:11.552163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169d02-3f56-47b5-90dd-88eb4794525c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:11.554365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d899-f067-40bd-abf0-80a44404f742 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:11.554869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d899-f067-40bd-abf0-80a44404f742 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:11.555351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5d899-f067-40bd-abf0-80a44404f742 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:11.556975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 96/210] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:11.565761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e546599-b17e-4d65-9589-cee444e63453 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:11.566054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e546599-b17e-4d65-9589-cee444e63453 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:11.566334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e546599-b17e-4d65-9589-cee444e63453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:11.577754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-71169d02-3f56-47b5-90dd-88eb4794525c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:11.579259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-71169d02-3f56-47b5-90dd-88eb4794525c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:11.586091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0e546599-b17e-4d65-9589-cee444e63453 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:11.587277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0e546599-b17e-4d65-9589-cee444e63453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:11.610098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:11.661434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 115/211] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:11.692160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 97/212] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:11.694707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71169d02-3f56-47b5-90dd-88eb4794525c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:11.745412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e546599-b17e-4d65-9589-cee444e63453 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:11.824987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71169d02-3f56-47b5-90dd-88eb4794525c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:11.851472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e546599-b17e-4d65-9589-cee444e63453 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:11.869422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:11.870593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:11.871171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:11.871656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:11.877665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:11.885732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:11.890360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:11.891166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:11.891463 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:11.891750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:11.893835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:11.895322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:11.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:11.897716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:11.898516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:11.899119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 98/213] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:11.900967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 116/214] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:11.902468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:11.911054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:11.938615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:12.037297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a8a5f-ce1d-4825-87cb-265f8795663d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:12.055363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b467b4a-b010-4eae-9d99-494222f45d88 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:12.079688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:12.081316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:12.081810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:12.082295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:12.083234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:12.083752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:12.085344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:12.098938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 117/215] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:12.100229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:12.100636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:12.100969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:12.101262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:12.101581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:12.102286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:12.103758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:12.136410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 99/216] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:11 2022] POST /identity/v3/users => generated 297 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:12.224764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:12.244621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7d4141-6c68-4971-8e6a-19a548e44c2d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:12.282784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:12.284612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:12.285167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:12.285595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] PATH_INFO: `/v3/users/ec4d0dc2a093490689b2f611300bdad3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:12.301650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4d0dc2a093490689b2f611300bdad3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:12.303376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:12.305684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 118/217] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:12 2022] GET /identity/v3/users/ec4d0dc2a093490689b2f611300bdad3 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:12.310902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:12.364884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:12.423663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f86bf5-0ae8-455e-ad35-8795dfd3ec15 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:12.458937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:12.459628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:12.459885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:12.460161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:12.536550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:12.538360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:12.594112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:12.658529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 100/218] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:12.664250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:12.792234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c093fd-f24f-4771-82e1-c5465c9b3966 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:12.828223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9a48ab-b508-4c27-9104-ecf703690a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:12.829123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a48ab-b508-4c27-9104-ecf703690a68 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:12.829408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a48ab-b508-4c27-9104-ecf703690a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:12.829685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9a48ab-b508-4c27-9104-ecf703690a68 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:12.830984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a48ab-b508-4c27-9104-ecf703690a68 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:12.832451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9a48ab-b508-4c27-9104-ecf703690a68 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:12.834453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 119/219] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:12 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:12.840209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:13.008897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7b588-234d-40b1-ad9a-2483752b9fb7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:13.058043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39029303-f80b-4116-9812-7e745bc1e281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:13.059058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39029303-f80b-4116-9812-7e745bc1e281 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.059550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39029303-f80b-4116-9812-7e745bc1e281 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.060047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39029303-f80b-4116-9812-7e745bc1e281 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:13.061114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39029303-f80b-4116-9812-7e745bc1e281 None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=ec4d0dc2a093490689b2f611300bdad3) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:13.061633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39029303-f80b-4116-9812-7e745bc1e281 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:13.063274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39029303-f80b-4116-9812-7e745bc1e281 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:13.072720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 101/220] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:12 2022] GET /identity/v3/role_assignments?user.id=ec4d0dc2a093490689b2f611300bdad3&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:13.337254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042205ae-d8da-4b1d-9c42-01d9da6eab91 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.337742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042205ae-d8da-4b1d-9c42-01d9da6eab91 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.337742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042205ae-d8da-4b1d-9c42-01d9da6eab91 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:13.340941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 120/221] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:13.343819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081f7b3-8782-4eb3-b4d8-76a1f0510d75 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.344363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081f7b3-8782-4eb3-b4d8-76a1f0510d75 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.344870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9081f7b3-8782-4eb3-b4d8-76a1f0510d75 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:13.348300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad7fc-e0ea-4d61-b3f0-fc2a56168f3b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.348560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 102/222] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:13.349185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad7fc-e0ea-4d61-b3f0-fc2a56168f3b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.349761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ad7fc-e0ea-4d61-b3f0-fc2a56168f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:13.358232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c33fa-8683-4cfb-8ce3-b81a15ef61e1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.358529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c33fa-8683-4cfb-8ce3-b81a15ef61e1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.358824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631c33fa-8683-4cfb-8ce3-b81a15ef61e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:13.381594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-631c33fa-8683-4cfb-8ce3-b81a15ef61e1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:13.383692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-631c33fa-8683-4cfb-8ce3-b81a15ef61e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:13.389477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-000ad7fc-e0ea-4d61-b3f0-fc2a56168f3b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:13.390695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-000ad7fc-e0ea-4d61-b3f0-fc2a56168f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:13.394479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:13.400727 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:13.464099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 103/223] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:13.490826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c33fa-8683-4cfb-8ce3-b81a15ef61e1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:13.603694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631c33fa-8683-4cfb-8ce3-b81a15ef61e1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:13.614165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 121/224] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:13.656978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:13.657791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.658079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.658355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:13.671355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:13.676412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:13.685050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:13.685979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:13.686762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:13.687368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ad7fc-e0ea-4d61-b3f0-fc2a56168f3b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:13.687440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 104/225] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:13.695063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:13.877753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea10f-239e-40af-b140-94b0e5cdc95a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:13.916845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ad7fc-e0ea-4d61-b3f0-fc2a56168f3b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:13.919276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:13.920175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.920703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.921193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:13.922164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:13.922663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:13.924272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:13.941493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 105/226] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:13.946674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:13.993545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:13.994782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:13.995264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:13.995758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.013039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:14.021171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:14.033206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:14.034786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:14.051804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 122/227] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:14.059115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:14.103244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:14.180511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98621880-e053-4ba8-a748-7ed435eb9fd0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:14.249506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:14.250756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.251236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.251702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] PATH_INFO: `/v3/users/14e290fbe22748d09645d53ce3ebb020` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.254054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] RBAC: Authorizing `identity:get_user(user_id=14e290fbe22748d09645d53ce3ebb020)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:14.255732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:14.261106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7c73-56b2-46af-80e3-b67e67698041 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:14.262937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 106/228] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:13 2022] GET /identity/v3/users/14e290fbe22748d09645d53ce3ebb020 => generated 283 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:14.264812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:14.307364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:14.308439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.308922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.309398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.310412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:14.310960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:14.313234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:14.326655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 123/229] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:14.332656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:14.448874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:14.475882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aa3600-6af6-4116-96ec-51e29166d31b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:14.522471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370a66d1-da6a-415f-97af-03450c4225d0 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:14.548770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:14.563281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:14.564172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.564480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.564763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.568321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:14.569832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:14.571582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 107/230] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:14 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:14.577190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:14.599770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:14.600692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.600979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.601258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] PATH_INFO: `/v3/users/14e290fbe22748d09645d53ce3ebb020` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.603889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] RBAC: Authorizing `identity:get_user(user_id=14e290fbe22748d09645d53ce3ebb020)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:14.605385 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:14.610177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 124/231] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:14 2022] GET /identity/v3/users/14e290fbe22748d09645d53ce3ebb020 => generated 283 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:14.613989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:14.812406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592fb58a-5158-416d-80a9-7d6c259bdb37 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:14.846262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee887faf-485d-441e-8299-8e9c926efcdf None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:14.847218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bf523e-9061-4272-8ea2-ee6e2f0cb1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:14.848278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf523e-9061-4272-8ea2-ee6e2f0cb1dd None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.848867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf523e-9061-4272-8ea2-ee6e2f0cb1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.852402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bf523e-9061-4272-8ea2-ee6e2f0cb1dd None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/14e290fbe22748d09645d53ce3ebb020/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.852402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf523e-9061-4272-8ea2-ee6e2f0cb1dd None admin] RBAC: Authorizing `identity:create_grant(project_id=ccdacc0de80446339111c9274d3fc1dc, user_id=14e290fbe22748d09645d53ce3ebb020, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:14.852872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16bf523e-9061-4272-8ea2-ee6e2f0cb1dd None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:14.868729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 108/232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:14 2022] PUT /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/14e290fbe22748d09645d53ce3ebb020/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:14.873871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491135-f003-4534-a02e-12a50dee5c4f None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.874144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491135-f003-4534-a02e-12a50dee5c4f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.880030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491135-f003-4534-a02e-12a50dee5c4f None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.884432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 109/233] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:14 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:14.900825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:14.903638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99cfa2-e937-4c76-973e-588e1f30e340 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.904080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99cfa2-e937-4c76-973e-588e1f30e340 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.904448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99cfa2-e937-4c76-973e-588e1f30e340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.921968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:14.928415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:14.928415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:14.928415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:14.928415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:14.928415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:14.929294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 125/234] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:14 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:14.940416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:14.972663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-bb99cfa2-e937-4c76-973e-588e1f30e340 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:14.972663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bb99cfa2-e937-4c76-973e-588e1f30e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:15.071656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e6225-59b9-498b-9285-cf9e1f2e4aef None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:15.087906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:15.112925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 110/235] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:15.114210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7374-1da6-4775-ae86-8b25f0f4a878 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.114506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7374-1da6-4775-ae86-8b25f0f4a878 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.114794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4b7374-1da6-4775-ae86-8b25f0f4a878 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.124406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 111/236] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:15.128407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:15.128407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.128407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.128407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/14e290fbe22748d09645d53ce3ebb020/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.132403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5a4e-989a-46c9-ada4-5cbb32d8e119 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.132522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] RBAC: Authorizing `identity:create_grant(project_id=ccdacc0de80446339111c9274d3fc1dc, user_id=14e290fbe22748d09645d53ce3ebb020, role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:15.132595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5a4e-989a-46c9-ada4-5cbb32d8e119 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.132595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62a5a4e-989a-46c9-ada4-5cbb32d8e119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.132734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:15.160416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 126/237] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:14 2022] PUT /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/14e290fbe22748d09645d53ce3ebb020/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:15.164404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:15.177654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c62a5a4e-989a-46c9-ada4-5cbb32d8e119 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:15.178830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c62a5a4e-989a-46c9-ada4-5cbb32d8e119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:15.248434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:15.373115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8916770e-ec3f-43f7-a0d4-e9f92a218f2c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:15.416726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:15.417782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.418074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.418363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.421671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 112/238] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:15.431557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:15.439478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:15.441084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:15.441873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:15.442476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 127/239] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:15.448282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a5a4e-989a-46c9-ada4-5cbb32d8e119 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:15.453733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:15.597792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62a5a4e-989a-46c9-ada4-5cbb32d8e119 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:15.622458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1932268-8e1f-4b65-b5c8-3c5b9d0b8bbb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:15.629682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:15.660713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8029f08-ea47-4e01-90c8-35502a7e6536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:15.661803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029f08-ea47-4e01-90c8-35502a7e6536 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.662279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029f08-ea47-4e01-90c8-35502a7e6536 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.662751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8029f08-ea47-4e01-90c8-35502a7e6536 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.664052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029f08-ea47-4e01-90c8-35502a7e6536 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:15.667589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029f08-ea47-4e01-90c8-35502a7e6536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:15.671647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8029f08-ea47-4e01-90c8-35502a7e6536 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:15.684812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:15.686812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 113/240] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:15.689218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a7525-f6f3-46d7-9f2b-df9ee6035e5e None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.689726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a7525-f6f3-46d7-9f2b-df9ee6035e5e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.690281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a7525-f6f3-46d7-9f2b-df9ee6035e5e None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.704979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:15.705113 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 114/241] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:15.705186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.705186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.705186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.705354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6d2fb-108c-4039-8e8c-ef721fdf1d6e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.705928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:15.706018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6d2fb-108c-4039-8e8c-ef721fdf1d6e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.706018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa6d2fb-108c-4039-8e8c-ef721fdf1d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.706134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:15.709123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 128/242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:15.710443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:15.741227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3aa6d2fb-108c-4039-8e8c-ef721fdf1d6e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:15.743404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3aa6d2fb-108c-4039-8e8c-ef721fdf1d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:15.819736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 115/243] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:15.820746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6d2fb-108c-4039-8e8c-ef721fdf1d6e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:15.851693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85a9039-ff19-488a-876c-5525303314e7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:15.891744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:15.892910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.893772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.894314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] PATH_INFO: `/v3/users/e2e69fc220f54fea906b3634b8ca5ae4` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.910424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e69fc220f54fea906b3634b8ca5ae4)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:15.912468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:15.914715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 129/244] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:15 2022] GET /identity/v3/users/e2e69fc220f54fea906b3634b8ca5ae4 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:15.915664 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:15.946709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa6d2fb-108c-4039-8e8c-ef721fdf1d6e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:15.958318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:15.980826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:15.990457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:15.991359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:15.991796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:15.992672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:15.993856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:15.996020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:16.022419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 116/245] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:15 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:16.030564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:16.079735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6953cd-6a49-4401-881b-fc1d447a45b1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:16.179408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94be825d-62cd-4799-9b7e-1afc465112ea None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:16.214834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:16.216004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:16.216791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:16.217274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:16.217797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:16.218455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:16.218798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:16.219082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:16.235679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:16.247604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:16.248564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:16.249449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:16.252821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 130/246] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:16.258380 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:16.266261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:16.314356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:16.317026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:16.399183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ec2c9-f479-47f6-8892-e98d2617f089 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:16.401543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:16.446701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:16.447877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:16.448269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:16.448806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:16.449810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:16.452014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:16.452014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:16.461836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 117/247] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:16.464143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 131/248] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:16.469178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:16.469612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:16.555962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:16.601539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cc350e-4277-43ad-ad2e-2e599572b2b9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:16.606023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ad0259-7061-4cf1-9fc3-7b99baff9a62 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:16.655671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:16.657167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:16.658512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:16.659982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] PATH_INFO: `/v3/users/ec4d0dc2a093490689b2f611300bdad3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:16.662687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:16.662813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4d0dc2a093490689b2f611300bdad3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:16.663871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:16.664259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:16.665013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:16.665498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:16.666285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 132/249] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:16 2022] GET /identity/v3/users/ec4d0dc2a093490689b2f611300bdad3 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:16.670270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:16.671635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:16.672300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:16.674359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 118/250] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:16 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:16.680325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:16.728756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:16.803050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a29a05b-ecea-4b01-bde9-b05e4be6a464 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:16.818655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291c6308-6fd3-4fac-84e0-c62d67e84651 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:16.865658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0925693-fdbc-4f6a-ba68-b60d70a8317f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:16.867526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0925693-fdbc-4f6a-ba68-b60d70a8317f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:16.868822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0925693-fdbc-4f6a-ba68-b60d70a8317f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:16.869458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:16.869988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0925693-fdbc-4f6a-ba68-b60d70a8317f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:16.871778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:16.872259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0925693-fdbc-4f6a-ba68-b60d70a8317f None admin] RBAC: Adding query filter params (role.id=2056b78da4104febafaea3f956d1fe6c, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=e2e69fc220f54fea906b3634b8ca5ae4) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:16.872776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:16.873291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0925693-fdbc-4f6a-ba68-b60d70a8317f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:16.873779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:16.875444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0925693-fdbc-4f6a-ba68-b60d70a8317f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:16.876963 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:16.881012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:16.883188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 133/251] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:16 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:16.883910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:16.890611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:16.893958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 119/252] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:16 2022] GET /identity/v3/role_assignments?user.id=e2e69fc220f54fea906b3634b8ca5ae4&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=2056b78da4104febafaea3f956d1fe6c => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:17.013964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e83c1d-91a6-4660-ae3e-7d674d60b1dc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:17.015896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:17.057187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd5688-eed8-42f0-a0f2-edb5a0721822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:17.058622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5688-eed8-42f0-a0f2-edb5a0721822 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:17.059127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5688-eed8-42f0-a0f2-edb5a0721822 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:17.059657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd5688-eed8-42f0-a0f2-edb5a0721822 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/ec4d0dc2a093490689b2f611300bdad3/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:17.062156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd5688-eed8-42f0-a0f2-edb5a0721822 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccdacc0de80446339111c9274d3fc1dc, user_id=ec4d0dc2a093490689b2f611300bdad3, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:17.063900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd5688-eed8-42f0-a0f2-edb5a0721822 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:17.085097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 134/253] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:16 2022] PUT /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/ec4d0dc2a093490689b2f611300bdad3/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:17.687455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6a75-6113-4036-b035-f9f054119f01 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:17.689005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6a75-6113-4036-b035-f9f054119f01 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:17.689854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1e6a75-6113-4036-b035-f9f054119f01 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:17.693478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 120/254] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:17.701913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34bd9-1412-4af2-a93a-3c0a7825c834 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:17.702396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34bd9-1412-4af2-a93a-3c0a7825c834 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:17.702469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead34bd9-1412-4af2-a93a-3c0a7825c834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:17.732901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-ead34bd9-1412-4af2-a93a-3c0a7825c834 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:17.734101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ead34bd9-1412-4af2-a93a-3c0a7825c834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:17.825911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ca76-254e-4007-b35d-3c655a2c2dd1 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:17.826538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ca76-254e-4007-b35d-3c655a2c2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:17.827011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758ca76-254e-4007-b35d-3c655a2c2dd1 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:17.828955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 121/255] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:17.834990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c3d1-cf2e-447f-ab53-30e3dff2f2ab None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:17.835558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c3d1-cf2e-447f-ab53-30e3dff2f2ab None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:17.836029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67c3d1-cf2e-447f-ab53-30e3dff2f2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:17.844674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 135/256] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:17.854789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-8e67c3d1-cf2e-447f-ab53-30e3dff2f2ab None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:17.856332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8e67c3d1-cf2e-447f-ab53-30e3dff2f2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:17.899772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34bd9-1412-4af2-a93a-3c0a7825c834 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:18.000329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 122/257] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:18.050367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67c3d1-cf2e-447f-ab53-30e3dff2f2ab None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:18.099604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:18.119632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead34bd9-1412-4af2-a93a-3c0a7825c834 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:18.194948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:18.195755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:18.196046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:18.196327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:18.220628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:18.234522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:18.235442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:18.236320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 136/258] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:18.244451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:18.300220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67c3d1-cf2e-447f-ab53-30e3dff2f2ab None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:18.355416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:18.378509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:18.379688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:18.380162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:18.380654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:18.398925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:18.407658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:18.408629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:18.409574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:18.413810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 123/259] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:18.419894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:18.444676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d29c31e-8d7b-4c14-bb39-14c8ec401022 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:18.500792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:18.501830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:18.502886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:18.503950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:18.505037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:18.505816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:18.507697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:18.519436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 137/260] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:18.525629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:18.566277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:18.640882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e62c6b-da27-4e1d-98ef-ad716e447b63 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:18.733427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:18.734189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:18.734562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:18.734854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:18.735627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:18.735941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:18.738150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:18.757429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 124/261] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:18.759585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a9dab5-f6aa-448c-9e62-9130e02c79b2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:18.775800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:18.834665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:18.835941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:18.837615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:18.839215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] PATH_INFO: `/v3/users/14e290fbe22748d09645d53ce3ebb020` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:18.841897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] RBAC: Authorizing `identity:get_user(user_id=14e290fbe22748d09645d53ce3ebb020)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:18.843563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:18.850798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 138/262] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:18 2022] GET /identity/v3/users/14e290fbe22748d09645d53ce3ebb020 => generated 283 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:18.861383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:18.869388 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:18.930721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4d4fb-d3af-4e14-bb8d-25e5935294f9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:18.974441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:18.975668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:18.976150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:18.976723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] PATH_INFO: `/v3/users/14e290fbe22748d09645d53ce3ebb020` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:18.978301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] RBAC: Authorizing `identity:get_user(user_id=14e290fbe22748d09645d53ce3ebb020)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:18.979965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:18.982504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 125/263] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:18 2022] GET /identity/v3/users/14e290fbe22748d09645d53ce3ebb020 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:18.995279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:19.048784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:19.079593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890d6dfc-b9bf-4fad-bb31-05ecccaa3f8e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:19.174679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:19.175727 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:19.176211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:19.176701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:19.191446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4ec7c8-e23c-456e-9ed6-49614fd36e95 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:19.227307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:19.258487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979336a6-be27-4431-a00b-5bcd14dda76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:19.260295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979336a6-be27-4431-a00b-5bcd14dda76d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:19.261392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979336a6-be27-4431-a00b-5bcd14dda76d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:19.262038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979336a6-be27-4431-a00b-5bcd14dda76d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:19.353582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:19.355429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:19.446655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979336a6-be27-4431-a00b-5bcd14dda76d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:19.448405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979336a6-be27-4431-a00b-5bcd14dda76d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:19.512141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:19.551086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 139/264] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:19.557726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:19.710771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8b1cf7-42c4-4a43-8808-acacd9294517 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:19.731460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 126/265] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 12:37:19.737937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ad6a8-790b-4194-afb8-d4c628c91027 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:19.740156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ad6a8-790b-4194-afb8-d4c628c91027 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:19.742289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7ad6a8-790b-4194-afb8-d4c628c91027 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:19.743883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 127/266] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:19.749796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0577-23e0-422e-8185-2190bcf0b19c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:19.750254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0577-23e0-422e-8185-2190bcf0b19c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:19.750674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232c0577-23e0-422e-8185-2190bcf0b19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:19.780617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:19.781493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:19.781780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:19.782056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:19.784916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-232c0577-23e0-422e-8185-2190bcf0b19c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:19.786133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-232c0577-23e0-422e-8185-2190bcf0b19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:19.788683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:19.790227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:19.792995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 140/267] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:19 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:19.793788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:19.820806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:19.905483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:19.929976 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 128/268] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:19.930846 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0577-23e0-422e-8185-2190bcf0b19c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.031451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5f9cae-6c77-459b-b3d7-9545d54d9e3c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.045821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232c0577-23e0-422e-8185-2190bcf0b19c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.068443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.069315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.069602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.069881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.071071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:20.072559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:20.074953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 141/269] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:19 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:20.077532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.088802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeb73db-d3d1-4e46-8605-9277c0f8be14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.090080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb73db-d3d1-4e46-8605-9277c0f8be14 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.090371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb73db-d3d1-4e46-8605-9277c0f8be14 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.090651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeb73db-d3d1-4e46-8605-9277c0f8be14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.091885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb73db-d3d1-4e46-8605-9277c0f8be14 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=14e290fbe22748d09645d53ce3ebb020) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:20.092196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb73db-d3d1-4e46-8605-9277c0f8be14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:20.093985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbeb73db-d3d1-4e46-8605-9277c0f8be14 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:20.100272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 129/270] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:19 2022] GET /identity/v3/role_assignments?user.id=14e290fbe22748d09645d53ce3ebb020&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:20.101549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0c19-70a3-427c-a9a8-0f50b6c9b9a1 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.101838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0c19-70a3-427c-a9a8-0f50b6c9b9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.102114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aca0c19-70a3-427c-a9a8-0f50b6c9b9a1 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.108436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 130/271] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:20.108436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0fb7-c8a8-4e12-b62f-9d98a5fc12d9 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.108436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0fb7-c8a8-4e12-b62f-9d98a5fc12d9 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.108436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df0fb7-c8a8-4e12-b62f-9d98a5fc12d9 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.108436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 131/272] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:20.108436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0fb7-c8a8-4e12-b62f-9d98a5fc12d9 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.146864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:20.206374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc7df96-4369-4ea6-ba38-7310ada5a1f7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.227068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:20.251689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b517718-8d67-40ff-9916-2df65392d13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.253677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517718-8d67-40ff-9916-2df65392d13c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.254118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517718-8d67-40ff-9916-2df65392d13c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.254707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b517718-8d67-40ff-9916-2df65392d13c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.256532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517718-8d67-40ff-9916-2df65392d13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:20.258195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b517718-8d67-40ff-9916-2df65392d13c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:20.260861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 142/273] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:20.262461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b288-cf7c-4afa-85a6-920f7ee88bbb None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.263109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b288-cf7c-4afa-85a6-920f7ee88bbb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.264872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f57b288-cf7c-4afa-85a6-920f7ee88bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.277447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df0fb7-c8a8-4e12-b62f-9d98a5fc12d9 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.285342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6f57b288-cf7c-4afa-85a6-920f7ee88bbb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:20.286499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6f57b288-cf7c-4afa-85a6-920f7ee88bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:20.323153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb613c38-43eb-49df-9931-b177e5a6e721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.323818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613c38-43eb-49df-9931-b177e5a6e721 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.324104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613c38-43eb-49df-9931-b177e5a6e721 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.324454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb613c38-43eb-49df-9931-b177e5a6e721 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.325741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb613c38-43eb-49df-9931-b177e5a6e721 None admin] RBAC: Adding query filter params (role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=14e290fbe22748d09645d53ce3ebb020) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:20.325741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb613c38-43eb-49df-9931-b177e5a6e721 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:20.327034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb613c38-43eb-49df-9931-b177e5a6e721 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:20.333696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 132/274] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:20 2022] GET /identity/v3/role_assignments?user.id=14e290fbe22748d09645d53ce3ebb020&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 608 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:20.334973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9be07-c175-4523-bbba-270129c0bad4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.335264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9be07-c175-4523-bbba-270129c0bad4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.335541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9be07-c175-4523-bbba-270129c0bad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.354597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d2f9be07-c175-4523-bbba-270129c0bad4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:20.355240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d2f9be07-c175-4523-bbba-270129c0bad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:20.378459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 143/275] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:20.379570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57b288-cf7c-4afa-85a6-920f7ee88bbb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.445981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 133/276] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:20.447511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a32a3-d3d4-42c0-b14a-f0ff608016b1 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.447885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a32a3-d3d4-42c0-b14a-f0ff608016b1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.448234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a32a3-d3d4-42c0-b14a-f0ff608016b1 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.449813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 134/277] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:20.450486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a32a3-d3d4-42c0-b14a-f0ff608016b1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.468748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:20.512335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f57b288-cf7c-4afa-85a6-920f7ee88bbb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.531721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:20.551001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd1779-0e0a-4679-8f78-5d2f0ef76517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.551589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1779-0e0a-4679-8f78-5d2f0ef76517 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.551875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1779-0e0a-4679-8f78-5d2f0ef76517 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.552152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1779-0e0a-4679-8f78-5d2f0ef76517 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.552898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd1779-0e0a-4679-8f78-5d2f0ef76517 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:20.554339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd1779-0e0a-4679-8f78-5d2f0ef76517 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:20.578535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 144/278] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:20 2022] POST /identity/v3/users => generated 293 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:20.579791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05a267-9388-47c1-a729-ba2ad95caa23 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.580082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05a267-9388-47c1-a729-ba2ad95caa23 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.580496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05a267-9388-47c1-a729-ba2ad95caa23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.583566 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a32a3-d3d4-42c0-b14a-f0ff608016b1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.600138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9f05a267-9388-47c1-a729-ba2ad95caa23 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:20.601397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9f05a267-9388-47c1-a729-ba2ad95caa23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:20.624995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.625817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.626103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.626377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.638878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:20.647671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:20.648712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:20.649657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:20.653923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 135/279] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:20.654858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.687881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 145/280] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:20.689027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05a267-9388-47c1-a729-ba2ad95caa23 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.750539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:20.798471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cddbed-2e5a-4c21-ac7f-1810464e32e4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.825667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05a267-9388-47c1-a729-ba2ad95caa23 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:20.827423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:20.842177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.842993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.843280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.843558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.857384 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:20.866488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:20.867392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:20.868174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 136/281] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:20.871796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.878853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:20.879547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:20.879833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:20.880109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:20.880901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:20.881209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:20.882762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:20.897117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 146/282] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:20.898431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:20.996480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dd5ca-3a55-44ab-9983-fb23834009b4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.015565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e7eeb-09c5-48e7-98aa-f3feafa17aeb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.026079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:21.038103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.039334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.039836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.040356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.053747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.054221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:21.054423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.054719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.055002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.055759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:21.056072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.057484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:21.063868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:21.064882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:21.065705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:21.067414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 147/283] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:21.068452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.068969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 137/284] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:21.074874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.098987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:21.188824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e393f1-6fd2-4279-aa8f-6be3276e4961 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.204617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05c7cdb-66f0-4550-86ab-8621d5cf7013 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.226282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.227297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.227742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.228163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] PATH_INFO: `/v3/users/e2e69fc220f54fea906b3634b8ca5ae4` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.229594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] RBAC: Authorizing `identity:get_user(user_id=e2e69fc220f54fea906b3634b8ca5ae4)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.231325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.233346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 148/285] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:21 2022] GET /identity/v3/users/e2e69fc220f54fea906b3634b8ca5ae4 => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:21.234265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.250351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.251490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.252183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.253030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] PATH_INFO: `/v3/users/dfe9eb0415654084949d8fc9b879162c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.271734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe9eb0415654084949d8fc9b879162c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.274795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.276605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 138/286] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:21 2022] GET /identity/v3/users/dfe9eb0415654084949d8fc9b879162c => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:21.277417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.340768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:21.342917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:21.352596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e11167-71e2-4a53-abbb-9b3df05c5bd9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.403464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.404931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.405727 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.406152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.407304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:21.408166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.410701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.418298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0b491-4d70-49ec-90e5-977c532fc112 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.422868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 149/287] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:21.423870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.470389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880feadd-9288-48c6-9086-b466af05677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.472303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880feadd-9288-48c6-9086-b466af05677a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.473251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880feadd-9288-48c6-9086-b466af05677a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.473690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880feadd-9288-48c6-9086-b466af05677a None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.475868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880feadd-9288-48c6-9086-b466af05677a None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.477948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880feadd-9288-48c6-9086-b466af05677a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.480737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 139/288] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:21 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:21.481972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880feadd-9288-48c6-9086-b466af05677a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.543173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a5058-882e-46b8-972c-c0cb3998f1fd None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.579018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.579816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.580205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.581907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.582248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, user.id=dfe9eb0415654084949d8fc9b879162c, scope.system=all) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:21.582688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.584226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.589950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 150/289] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 30 12:37:21 2022] GET /identity/v3/role_assignments?user.id=dfe9eb0415654084949d8fc9b879162c&scope.system=all&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:21.590943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.631312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:21.651752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880feadd-9288-48c6-9086-b466af05677a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.686141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:21.717036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.718033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.718580 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.718867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] PATH_INFO: `/v3/users/ec4d0dc2a093490689b2f611300bdad3` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.720143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] RBAC: Authorizing `identity:get_user(user_id=ec4d0dc2a093490689b2f611300bdad3)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.723034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.725214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 140/290] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:21 2022] GET /identity/v3/users/ec4d0dc2a093490689b2f611300bdad3 => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:21.734076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:21.829569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2df524-d10d-405d-91f7-3c010da64c90 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.901551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.902393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.902678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.902959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/e2e69fc220f54fea906b3634b8ca5ae4/roles/2056b78da4104febafaea3f956d1fe6c` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:21.907412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccdacc0de80446339111c9274d3fc1dc, user_id=e2e69fc220f54fea906b3634b8ca5ae4, role_id=2056b78da4104febafaea3f956d1fe6c)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:21.910127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:21.936624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 151/291] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:21 2022] PUT /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc/users/e2e69fc220f54fea906b3634b8ca5ae4/roles/2056b78da4104febafaea3f956d1fe6c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:21.949189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f9b76-caa6-4bc8-b6a9-4c9312206386 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:21.998455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:21.999117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:21.999412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:21.999697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:22.057608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:22.082773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:22.084308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:22.198332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 141/292] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:22.203717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:22.322575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:22.350667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205d5b6-ab5f-426c-8d23-82aced8ed457 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:22.398392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb4dbe-adc5-46d4-8972-a6a20fc3fb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:22.399310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb4dbe-adc5-46d4-8972-a6a20fc3fb43 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:22.399596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb4dbe-adc5-46d4-8972-a6a20fc3fb43 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:22.399894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb4dbe-adc5-46d4-8972-a6a20fc3fb43 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:22.401213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb4dbe-adc5-46d4-8972-a6a20fc3fb43 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:22.402643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb4dbe-adc5-46d4-8972-a6a20fc3fb43 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:22.404652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 152/293] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:22 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:22.410812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:22.522670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:22.543589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43d153d-7f09-4fa5-b72e-05138b13e781 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:22.580173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453bc093-9dc4-4ec1-a81e-6a93842b43a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:22.581084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc093-9dc4-4ec1-a81e-6a93842b43a6 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:22.581508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc093-9dc4-4ec1-a81e-6a93842b43a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:22.581800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453bc093-9dc4-4ec1-a81e-6a93842b43a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:22.582657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc093-9dc4-4ec1-a81e-6a93842b43a6 None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=ec4d0dc2a093490689b2f611300bdad3) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:22.582974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc093-9dc4-4ec1-a81e-6a93842b43a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:22.584479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453bc093-9dc4-4ec1-a81e-6a93842b43a6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:22.590883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 142/294] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:22 2022] GET /identity/v3/role_assignments?user.id=ec4d0dc2a093490689b2f611300bdad3&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:23.144740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4812de-d547-4154-b8fd-869171bed271 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.145479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4812de-d547-4154-b8fd-869171bed271 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.145479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4812de-d547-4154-b8fd-869171bed271 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.146952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 153/295] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:23.151536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e468-553a-458d-b40b-0b34e32068dd None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.152415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e468-553a-458d-b40b-0b34e32068dd None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.152929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f6e468-553a-458d-b40b-0b34e32068dd None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.155075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 143/296] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:23.156770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fd44b-79fd-4494-92f8-f472c7b63665 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.157263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fd44b-79fd-4494-92f8-f472c7b63665 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.157772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41fd44b-79fd-4494-92f8-f472c7b63665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.161187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02cff-259f-42e3-ad48-eaa4ad163f59 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.161723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02cff-259f-42e3-ad48-eaa4ad163f59 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.162195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e02cff-259f-42e3-ad48-eaa4ad163f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.185853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b3e02cff-259f-42e3-ad48-eaa4ad163f59 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:23.186624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-d41fd44b-79fd-4494-92f8-f472c7b63665 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:23.187032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b3e02cff-259f-42e3-ad48-eaa4ad163f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:23.188109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d41fd44b-79fd-4494-92f8-f472c7b63665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:23.273477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 144/297] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:23.284403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 154/298] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:23.296298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02cff-259f-42e3-ad48-eaa4ad163f59 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:23.302646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fd44b-79fd-4494-92f8-f472c7b63665 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:23.401604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:23.404074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:23.427505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41fd44b-79fd-4494-92f8-f472c7b63665 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:23.440439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e02cff-259f-42e3-ad48-eaa4ad163f59 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:23.467287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:23.468473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.468980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.469457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.482641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:23.483916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:23.484738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.485025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.485300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.486510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:23.488763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:23.492411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 145/299] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:23.495933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:23.497776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:23.498840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:23.499652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:23.502119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 155/300] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:23.516085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:23.604453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e53b40-8cf1-4a4c-b0eb-064fc9cb73d7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:23.613472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9459c7-4dc4-4c34-9254-a2a842999e1f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:23.640902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:23.641915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.642904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.643376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] PATH_INFO: `/v3/groups` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.644264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:23.645977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:23.650341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:23.651157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.651284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.651551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.652424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:23.652628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:23.654014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:23.659933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:23.665576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 146/301] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jun 30 12:37:23 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:37:23.668295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 156/302] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:23.670785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:23.673786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:23.792399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1100d9-88d2-4630-9606-afa44896f1ce None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:23.831110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754e00c-5869-45d1-a9b6-d3a55af9f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:23.832002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e00c-5869-45d1-a9b6-d3a55af9f52a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.832282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e00c-5869-45d1-a9b6-d3a55af9f52a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.832588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754e00c-5869-45d1-a9b6-d3a55af9f52a None admin] PATH_INFO: `/v3/users/47e8595aa40543c5ab0c288c80ae2402` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.847696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754e00c-5869-45d1-a9b6-d3a55af9f52a None admin] RBAC: Authorizing `identity:get_user(user_id=47e8595aa40543c5ab0c288c80ae2402)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:23.849226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5754e00c-5869-45d1-a9b6-d3a55af9f52a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:23.851269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 147/303] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:23 2022] GET /identity/v3/users/47e8595aa40543c5ab0c288c80ae2402 => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:23.857001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:23.899405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaecaa-69aa-4b8b-bf60-fd8660a3d485 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.899712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaecaa-69aa-4b8b-bf60-fd8660a3d485 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.899966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaecaa-69aa-4b8b-bf60-fd8660a3d485 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.901549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 148/304] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:23.906938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ea11-7456-4c7d-9901-8dcc6caf3ba8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:23.907154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ea11-7456-4c7d-9901-8dcc6caf3ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:23.907434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c0ea11-7456-4c7d-9901-8dcc6caf3ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:23.924941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f1c0ea11-7456-4c7d-9901-8dcc6caf3ba8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:23.926194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f1c0ea11-7456-4c7d-9901-8dcc6caf3ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:23.967073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62926db6-e0be-4834-862d-3971fc7950a0 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:23.991282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:24.007726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 149/305] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:24.009117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:24.009784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.010073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.010354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.011191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] RBAC: Adding query filter params (role.id=2056b78da4104febafaea3f956d1fe6c, user.id=47e8595aa40543c5ab0c288c80ae2402, scope.system=all) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:24.011509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:24.013014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:24.019437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 157/306] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 30 12:37:23 2022] GET /identity/v3/role_assignments?user.id=47e8595aa40543c5ab0c288c80ae2402&scope.system=all&role.id=2056b78da4104febafaea3f956d1fe6c => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:24.032705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ea11-7456-4c7d-9901-8dcc6caf3ba8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:24.146645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c0ea11-7456-4c7d-9901-8dcc6caf3ba8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:24.185667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17b350a-211f-43b9-9066-1b29efb665d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:24.186406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b350a-211f-43b9-9066-1b29efb665d8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.186684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b350a-211f-43b9-9066-1b29efb665d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.186966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17b350a-211f-43b9-9066-1b29efb665d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.201168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17b350a-211f-43b9-9066-1b29efb665d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-d17b350a-211f-43b9-9066-1b29efb665d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:24.209561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:24.210484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:24.211929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 150/307] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:24.216853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:24.289756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:24.330661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b181958-6cda-4158-8f88-89db24d19491 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:24.332431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93415-10eb-4357-8678-0784e28f79f0 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.334007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93415-10eb-4357-8678-0784e28f79f0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.334007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf93415-10eb-4357-8678-0784e28f79f0 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.334929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 151/308] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:24.340084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7fede-2329-4cee-92b7-b43a2d8b2fa5 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.340376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7fede-2329-4cee-92b7-b43a2d8b2fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.340687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd7fede-2329-4cee-92b7-b43a2d8b2fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.362521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7fd7fede-2329-4cee-92b7-b43a2d8b2fa5 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:24.364258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7fd7fede-2329-4cee-92b7-b43a2d8b2fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:24.372101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:24.373111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.373626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.374167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.375173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:24.375685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:24.377820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:24.387479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 158/309] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:24.395359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:24.423306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:24.452483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 152/310] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:24.480698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7fede-2329-4cee-92b7-b43a2d8b2fa5 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:24.505275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32a981e-d272-440c-ba02-a8d5041764db None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:24.534781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:24.546872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:24.548121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.548422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.548710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] PATH_INFO: `/v3/users/dfe9eb0415654084949d8fc9b879162c` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.550666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] RBAC: Authorizing `identity:get_user(user_id=dfe9eb0415654084949d8fc9b879162c)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:24.552698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:24.556500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 159/311] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:24 2022] GET /identity/v3/users/dfe9eb0415654084949d8fc9b879162c => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:24.560518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:24.620687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd7fede-2329-4cee-92b7-b43a2d8b2fa5 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:24.659362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:24.660569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.661057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.661553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.678775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:24.682270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ad92ad-a6d8-4b11-8775-b9e270ba8f2c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:24.687266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:24.688125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:24.688993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:24.701643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 153/312] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:24.702841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:24.721387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:24.722783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.723071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.723357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] PATH_INFO: `/v3/system/users/dfe9eb0415654084949d8fc9b879162c/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.725161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=dfe9eb0415654084949d8fc9b879162c, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:24.726966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:24.739876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 160/313] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jun 30 12:37:24 2022] PUT /identity/v3/system/users/dfe9eb0415654084949d8fc9b879162c/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:24.755013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:24.826936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245efbe1-550c-4cd1-898b-d3d03ca40133 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:24.875726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:24.876894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:24.877450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:24.878073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:24.879078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:24.879628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:24.881406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:24.891999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 154/314] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:24.904434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:24.969991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:25.014381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2798b07-cf7f-4bd1-81ea-ccc56af9de6a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:25.050005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:25.051257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:25.051752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:25.052238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] PATH_INFO: `/v3/users/e2e69fc220f54fea906b3634b8ca5ae4` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:25.053696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] RBAC: Authorizing `identity:get_user(user_id=e2e69fc220f54fea906b3634b8ca5ae4)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:25.055425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:25.057646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 161/315] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:24 2022] GET /identity/v3/users/e2e69fc220f54fea906b3634b8ca5ae4 => generated 297 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:25.064869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:25.172625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379ff66-fd41-4e83-91df-480c6811a380 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:25.174726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:25.209904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:25.210544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:25.210838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:25.211122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:25.285678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:25.287149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:25.392565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 155/316] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:25.395165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:25.511685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5e461-4b7b-4476-9239-c2a33655a46d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:25.539304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:25.548298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f4153b-fe8a-406b-9623-535a160d2bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:25.549224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4153b-fe8a-406b-9623-535a160d2bf9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:25.549556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4153b-fe8a-406b-9623-535a160d2bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:25.549791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f4153b-fe8a-406b-9623-535a160d2bf9 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:25.551049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4153b-fe8a-406b-9623-535a160d2bf9 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:25.552770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f4153b-fe8a-406b-9623-535a160d2bf9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:25.554499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 162/317] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:25 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:25.560543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:25.565252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:25.665361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea69e8-6c4c-4a7b-b72f-7b3e11b658b4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:25.699809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4964ad2b-2897-45bd-bcca-e0e5c930706d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:25.700514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ad2b-2897-45bd-bcca-e0e5c930706d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:25.700807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ad2b-2897-45bd-bcca-e0e5c930706d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:25.701091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4964ad2b-2897-45bd-bcca-e0e5c930706d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:25.701937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ad2b-2897-45bd-bcca-e0e5c930706d None admin] RBAC: Adding query filter params (role.id=2056b78da4104febafaea3f956d1fe6c, scope.project.id=ccdacc0de80446339111c9274d3fc1dc, user.id=e2e69fc220f54fea906b3634b8ca5ae4) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:25.702257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ad2b-2897-45bd-bcca-e0e5c930706d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:25.703704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4964ad2b-2897-45bd-bcca-e0e5c930706d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:25.716531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 156/318] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:25 2022] GET /identity/v3/role_assignments?user.id=e2e69fc220f54fea906b3634b8ca5ae4&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=2056b78da4104febafaea3f956d1fe6c => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:25.885157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68190-4aa5-439e-bd2c-a697f706efe2 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:25.885489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68190-4aa5-439e-bd2c-a697f706efe2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:25.885674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e68190-4aa5-439e-bd2c-a697f706efe2 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:25.887255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 163/319] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:25.893427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079587ad-0fb7-4739-97c2-0defd1b143f1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:25.893730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079587ad-0fb7-4739-97c2-0defd1b143f1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:25.894017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079587ad-0fb7-4739-97c2-0defd1b143f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:25.912772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-079587ad-0fb7-4739-97c2-0defd1b143f1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:25.913982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-079587ad-0fb7-4739-97c2-0defd1b143f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:25.980985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:25.992419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 157/320] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:26.013596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68190-4aa5-439e-bd2c-a697f706efe2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:26.122405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e68190-4aa5-439e-bd2c-a697f706efe2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:26.160402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe31b3-1835-4e7e-81c7-ba9b71992fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:26.160402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe31b3-1835-4e7e-81c7-ba9b71992fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:26.160773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe31b3-1835-4e7e-81c7-ba9b71992fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:26.160951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe31b3-1835-4e7e-81c7-ba9b71992fb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:26.162321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe31b3-1835-4e7e-81c7-ba9b71992fb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:26.163901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe31b3-1835-4e7e-81c7-ba9b71992fb2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:26.165921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 164/321] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:26.171171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079587ad-0fb7-4739-97c2-0defd1b143f1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:26.200509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9bca1-e27c-48f8-a5ca-b24d4cb41171 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:26.200813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9bca1-e27c-48f8-a5ca-b24d4cb41171 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:26.201081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f9bca1-e27c-48f8-a5ca-b24d4cb41171 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:26.202463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 165/322] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:26.208367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ada8-09e9-4d1f-9cb4-82d8a41e58c3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:26.208695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ada8-09e9-4d1f-9cb4-82d8a41e58c3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:26.209033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ada8-09e9-4d1f-9cb4-82d8a41e58c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:26.225915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5ca9ada8-09e9-4d1f-9cb4-82d8a41e58c3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:26.227015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5ca9ada8-09e9-4d1f-9cb4-82d8a41e58c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:26.277819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079587ad-0fb7-4739-97c2-0defd1b143f1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:26.294628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:26.307449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 166/323] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:26.316114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:26.316836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:26.317180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:26.317467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] PATH_INFO: `/v3/groups` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:26.318166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:26.319606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:26.332571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ada8-09e9-4d1f-9cb4-82d8a41e58c3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:26.336712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 158/324] 10.222.0.20 () {60 vars in 1134 bytes} [Thu Jun 30 12:37:26 2022] POST /identity/v3/groups => generated 226 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:26.452315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ada8-09e9-4d1f-9cb4-82d8a41e58c3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:26.494143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:26.494951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:26.495672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:26.495672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:26.508823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:26.516638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:26.518554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:26.519555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:26.523863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 167/325] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:26.525077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:26.603065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:26.662522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e3372-e070-4fc3-b2ce-6ad3101c32c0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:26.712660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:26.713331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:26.713623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:26.713913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:26.714742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:26.715058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:26.716502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:26.726139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 159/326] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:26.731503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:26.803943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:26.860047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b1b6b-c60b-4abd-a19f-b5d3bebc3e68 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:26.913560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d25ebfc-a976-4b2d-9f8a-8790e055b95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:26.914468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ebfc-a976-4b2d-9f8a-8790e055b95f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:26.915031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ebfc-a976-4b2d-9f8a-8790e055b95f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:26.915417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d25ebfc-a976-4b2d-9f8a-8790e055b95f None admin] PATH_INFO: `/v3/users/47e8595aa40543c5ab0c288c80ae2402` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:26.917384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ebfc-a976-4b2d-9f8a-8790e055b95f None admin] RBAC: Authorizing `identity:get_user(user_id=47e8595aa40543c5ab0c288c80ae2402)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:26.918850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d25ebfc-a976-4b2d-9f8a-8790e055b95f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:26.921001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 168/327] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:26 2022] GET /identity/v3/users/47e8595aa40543c5ab0c288c80ae2402 => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:26.928648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:27.023902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6622f-8303-4023-800f-59d32c3e0ff9 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:27.024278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6622f-8303-4023-800f-59d32c3e0ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:27.024505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6622f-8303-4023-800f-59d32c3e0ff9 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:27.026137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 169/328] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:27.031492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357facc-3733-4401-b6e7-121258c434b9 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:27.031786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357facc-3733-4401-b6e7-121258c434b9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:27.032072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f357facc-3733-4401-b6e7-121258c434b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:27.057561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f357facc-3733-4401-b6e7-121258c434b9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:27.058218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f357facc-3733-4401-b6e7-121258c434b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:27.069654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65aae01-ea7d-4e06-8a4e-60851e09b8d8 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:27.092171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:27.115973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:27.116884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:27.117175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:27.117466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] PATH_INFO: `/v3/system/users/47e8595aa40543c5ab0c288c80ae2402/roles/2056b78da4104febafaea3f956d1fe6c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:27.119177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=47e8595aa40543c5ab0c288c80ae2402, role_id=2056b78da4104febafaea3f956d1fe6c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:27.120986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:27.136868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 160/329] 10.222.0.20 () {58 vars in 1334 bytes} [Thu Jun 30 12:37:26 2022] PUT /identity/v3/system/users/47e8595aa40543c5ab0c288c80ae2402/roles/2056b78da4104febafaea3f956d1fe6c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:27.164677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 170/330] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:27.193675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:27.338800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958ec64-5732-489e-935d-aeaf869ba500 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:27.378363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:27.379174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:27.379464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:27.379747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:27.393215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:27.401312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:27.402235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:27.403026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 161/331] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:27.408804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357facc-3733-4401-b6e7-121258c434b9 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:27.468371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:27.527333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f357facc-3733-4401-b6e7-121258c434b9 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:27.573665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:27.574600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:27.574890 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:27.575176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:27.575940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:27.576256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:27.577672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:27.589334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 171/332] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:27.596927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:27.654123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:27.717910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2253c4-8b56-4cc4-8e55-7b455b8516fb None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:27.758227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac11421a-22b0-4a89-8e0c-1ebe61946877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:27.759664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11421a-22b0-4a89-8e0c-1ebe61946877 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:27.760154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11421a-22b0-4a89-8e0c-1ebe61946877 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:27.760848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac11421a-22b0-4a89-8e0c-1ebe61946877 None admin] PATH_INFO: `/v3/users/dfe9eb0415654084949d8fc9b879162c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:27.762876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11421a-22b0-4a89-8e0c-1ebe61946877 None admin] RBAC: Authorizing `identity:get_user(user_id=dfe9eb0415654084949d8fc9b879162c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:27.765647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac11421a-22b0-4a89-8e0c-1ebe61946877 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:27.769023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 162/333] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:27 2022] GET /identity/v3/users/dfe9eb0415654084949d8fc9b879162c => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:27.774873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:27.891775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8191d-8c79-466d-a287-c6848cd73810 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:27.914317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:27.938245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affc0f7e-f317-4d8c-94bc-954b3cd824fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:27.938909 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc0f7e-f317-4d8c-94bc-954b3cd824fc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:27.939197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc0f7e-f317-4d8c-94bc-954b3cd824fc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:27.939985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affc0f7e-f317-4d8c-94bc-954b3cd824fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:27.941500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc0f7e-f317-4d8c-94bc-954b3cd824fc None admin] RBAC: Adding query filter params (role.id=60b18f6f37f34c88be6d03d808bc0d04, user.id=dfe9eb0415654084949d8fc9b879162c, scope.system=all) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:27.941817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc0f7e-f317-4d8c-94bc-954b3cd824fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:27.943261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affc0f7e-f317-4d8c-94bc-954b3cd824fc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:27.957462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 172/334] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 30 12:37:27 2022] GET /identity/v3/role_assignments?user.id=dfe9eb0415654084949d8fc9b879162c&scope.system=all&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 510 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:29.063950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f54e9-1525-4662-aaae-3eeebd79d987 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.065220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f54e9-1525-4662-aaae-3eeebd79d987 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.065220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f54e9-1525-4662-aaae-3eeebd79d987 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:29.067040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 163/335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:29.072570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b7ca-e71f-405e-9a71-90b703bb08f6 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.073063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b7ca-e71f-405e-9a71-90b703bb08f6 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.073155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6097b7ca-e71f-405e-9a71-90b703bb08f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:29.097607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6097b7ca-e71f-405e-9a71-90b703bb08f6 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:29.098845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6097b7ca-e71f-405e-9a71-90b703bb08f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:29.175693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 173/336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:29.200214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f54e9-1525-4662-aaae-3eeebd79d987 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:29.345272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2f54e9-1525-4662-aaae-3eeebd79d987 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:29.363601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:29.369157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007861a-5480-4255-9663-509a50e0f56a None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.369451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007861a-5480-4255-9663-509a50e0f56a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.369741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4007861a-5480-4255-9663-509a50e0f56a None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:29.371129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 174/337] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:29.377013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af425f-1865-486b-b7f8-829920242586 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.377362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af425f-1865-486b-b7f8-829920242586 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.377557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38af425f-1865-486b-b7f8-829920242586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:29.397334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:29.398159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.398445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.398725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:29.412247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:29.413393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-38af425f-1865-486b-b7f8-829920242586 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:29.414587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-38af425f-1865-486b-b7f8-829920242586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:29.420901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:29.423056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:29.425807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 164/338] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:29.432039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:29.553878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 175/339] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:29.579741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27ee2-b7c8-4593-9806-54b8a68ade43 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:29.628238 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:29.628873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.629356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.629637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:29.630409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:29.630724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:29.632117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:29.646292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 165/340] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:29.648483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af425f-1865-486b-b7f8-829920242586 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:29.652264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:29.714186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:29.735478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:29.884473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38af425f-1865-486b-b7f8-829920242586 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:29.904471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cbc4-0bbc-4056-89f3-8d6fc4085b01 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:29.973132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:29.974041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.974344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.974628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:29.987599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:29.988318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:29.988625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:29.988903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.005345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:30.013216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:30.014123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:30.014918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 176/341] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 367 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:30.025781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:30.147112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:30.148576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:30.218254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:30.266368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:30.298375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ed42b-5ade-4a7d-a862-0e6126aaaefe None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:30.302076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 166/342] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:30.308346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:30.370304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:30.370998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.371284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.371562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.372485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:30.372801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:30.374275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:30.389261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 177/343] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:30.395512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:30.449951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a1b649-39d5-42c6-908c-310ae5b1d4de None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:30.505424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:30.513205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:30.514094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.514428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.514709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.515915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:30.518318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:30.520354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 167/344] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:30 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:30.525609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:30.556216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0237bc-2f94-4f6a-bfca-fa5511572aef None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:30.613182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bd712-0c02-417a-aef0-3bf78bf87ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:30.614256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd712-0c02-417a-aef0-3bf78bf87ccf None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.614761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd712-0c02-417a-aef0-3bf78bf87ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.615246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bd712-0c02-417a-aef0-3bf78bf87ccf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.648031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:30.667094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463f8b5-401f-49b3-8e2f-d14ad4a727f9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:30.722275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:30.723486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.723977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.724475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.730349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bd712-0c02-417a-aef0-3bf78bf87ccf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:30.732032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bd712-0c02-417a-aef0-3bf78bf87ccf None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:30.737559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:30.739267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:30.741562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 168/345] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:30 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:30.747014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:30.868745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:30.909374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 178/346] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 12:37:30.911013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28577d-794d-4a9d-8790-475541ba9d73 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.911464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28577d-794d-4a9d-8790-475541ba9d73 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.911887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28577d-794d-4a9d-8790-475541ba9d73 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.913386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 179/347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:30.914645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a00844-cd68-4c6c-b919-47c1f3e791f6 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.915120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a00844-cd68-4c6c-b919-47c1f3e791f6 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.915614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a00844-cd68-4c6c-b919-47c1f3e791f6 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.917058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 180/348] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:30.921346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a00844-cd68-4c6c-b919-47c1f3e791f6 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:30.927700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed89ff4-86b4-42d3-9a01-05355bd57ac2 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:30.975999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0127054a-5e8c-413a-a4dc-6b159644608f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:30.975999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127054a-5e8c-413a-a4dc-6b159644608f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.976432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127054a-5e8c-413a-a4dc-6b159644608f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.976617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127054a-5e8c-413a-a4dc-6b159644608f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.977457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127054a-5e8c-413a-a4dc-6b159644608f None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:30.977772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127054a-5e8c-413a-a4dc-6b159644608f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:30.979239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0127054a-5e8c-413a-a4dc-6b159644608f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:30.985813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 169/349] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:30 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:30.987785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e8b9-7f22-4232-9e38-bec17ee8c353 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:30.988087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e8b9-7f22-4232-9e38-bec17ee8c353 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:30.988363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e75e8b9-7f22-4232-9e38-bec17ee8c353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:30.994139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:31.017655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6e75e8b9-7f22-4232-9e38-bec17ee8c353 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:31.019369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6e75e8b9-7f22-4232-9e38-bec17ee8c353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:31.061032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a00844-cd68-4c6c-b919-47c1f3e791f6 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:31.110509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 170/350] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:31.111591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a283b2-498f-4f2e-b225-7b6da8691aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:31.116405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a283b2-498f-4f2e-b225-7b6da8691aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.116405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a283b2-498f-4f2e-b225-7b6da8691aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.116405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a283b2-498f-4f2e-b225-7b6da8691aa0 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.116405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a283b2-498f-4f2e-b225-7b6da8691aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:31.116405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a283b2-498f-4f2e-b225-7b6da8691aa0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:31.117092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbf75b-f343-423d-aadc-64235893ef54 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.117636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbf75b-f343-423d-aadc-64235893ef54 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.118135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbf75b-f343-423d-aadc-64235893ef54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.118244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 181/351] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:30 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:31.119599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452004c-d51c-43e7-a33d-66ee93644307 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.119964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452004c-d51c-43e7-a33d-66ee93644307 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.120411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452004c-d51c-43e7-a33d-66ee93644307 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.127482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 182/352] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:31.134972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a2df2-26dc-4670-8393-40a510ee2d4b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.135590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a2df2-26dc-4670-8393-40a510ee2d4b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.136040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a2df2-26dc-4670-8393-40a510ee2d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.148913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-06fbf75b-f343-423d-aadc-64235893ef54 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:31.151673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-06fbf75b-f343-423d-aadc-64235893ef54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:31.167001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a06a2df2-26dc-4670-8393-40a510ee2d4b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:31.168614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a06a2df2-26dc-4670-8393-40a510ee2d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:31.228919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:31.233674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 171/353] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:31.234784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbf75b-f343-423d-aadc-64235893ef54 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:31.264415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 183/354] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:31.264415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a2df2-26dc-4670-8393-40a510ee2d4b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:31.336823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:31.374759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbf75b-f343-423d-aadc-64235893ef54 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:31.405340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a2df2-26dc-4670-8393-40a510ee2d4b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:31.420650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:31.421804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.422097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.422381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.424771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:31.426552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:31.428748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 172/355] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:31.429530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:31.456360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:31.457242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.457529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.457807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.473635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:31.485151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:31.486093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:31.487437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 184/356] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:31.492539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:31.511162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:31.579388 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86171d0-aecc-47ca-86a5-d0e172e06b49 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:31.629199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:31.630389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.630935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.631428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.639681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d3ca18-e411-46fb-b204-6f92d84f2da1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:31.645222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:31.653887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:31.654783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:31.655572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 173/357] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:31.656237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:31.659219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:31.697812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:31.699139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.699139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.699292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.712375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:31.720692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:31.722313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 185/358] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:31.723191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:31.798040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4432474-0821-40a9-99a8-6613d6673d77 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:31.829827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:31.848589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a4c94-65c3-4b7d-9120-d004af9d1cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:31.849643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4c94-65c3-4b7d-9120-d004af9d1cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.849937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4c94-65c3-4b7d-9120-d004af9d1cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.850223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a4c94-65c3-4b7d-9120-d004af9d1cf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.851075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a4c94-65c3-4b7d-9120-d004af9d1cf8 None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:31.851397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a4c94-65c3-4b7d-9120-d004af9d1cf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:31.853021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a4c94-65c3-4b7d-9120-d004af9d1cf8 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:31.859642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 174/359] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 260 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:31.864532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6821815-d81e-445e-8334-1d4842e3bbd6 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.864532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6821815-d81e-445e-8334-1d4842e3bbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.864532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6821815-d81e-445e-8334-1d4842e3bbd6 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.864532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 175/360] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:31.865124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6821815-d81e-445e-8334-1d4842e3bbd6 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:31.897137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e481d3-7c17-4756-b7f0-711910af5120 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:31.949737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:31.950439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:31.950730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:31.951010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:31.951959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:31.952284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:31.954623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:31.966386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 186/361] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:31.967708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:32.008249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6821815-d81e-445e-8334-1d4842e3bbd6 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:32.026128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:32.058894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7f31d6-68e6-4d7b-bf24-2136f26e686d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:32.059822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f31d6-68e6-4d7b-bf24-2136f26e686d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:32.060259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f31d6-68e6-4d7b-bf24-2136f26e686d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:32.060713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7f31d6-68e6-4d7b-bf24-2136f26e686d None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:32.061633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f31d6-68e6-4d7b-bf24-2136f26e686d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:32.062091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f31d6-68e6-4d7b-bf24-2136f26e686d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:32.063644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7f31d6-68e6-4d7b-bf24-2136f26e686d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:32.074567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 176/362] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:32.075776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59a0b-a3ea-4336-8274-a86b7e1c49f1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:32.076072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59a0b-a3ea-4336-8274-a86b7e1c49f1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:32.076350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad59a0b-a3ea-4336-8274-a86b7e1c49f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:32.103366 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-dad59a0b-a3ea-4336-8274-a86b7e1c49f1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:32.104834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-dad59a0b-a3ea-4336-8274-a86b7e1c49f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:32.155340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aab987-a4b8-4fcd-9265-b3589322d875 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:32.160322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:32.207182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:32.207863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:32.208146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:32.208445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:32.209203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:32.209510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:32.210961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:32.213067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 177/363] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:32.213936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad59a0b-a3ea-4336-8274-a86b7e1c49f1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:32.220350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 187/364] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:32.221288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:32.346989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad59a0b-a3ea-4336-8274-a86b7e1c49f1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:32.348849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:32.358291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67e83c-d10f-4296-b23a-99985c444f82 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:32.396226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:32.396917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:32.397200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:32.397478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:32.401711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:32.402889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:32.403179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:32.404466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] PATH_INFO: `/v3/users/47e8595aa40543c5ab0c288c80ae2402` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:32.405736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] RBAC: Authorizing `identity:get_user(user_id=47e8595aa40543c5ab0c288c80ae2402)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:32.407181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:32.409692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 188/365] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:37:32 2022] GET /identity/v3/users/47e8595aa40543c5ab0c288c80ae2402 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:32.411147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:32.472786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:32.503540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:32.505628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:32.545344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525f0f4e-2d10-45d9-a015-f4be139cdc3d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:32.585703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:32.586743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:32.587254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:32.587793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:32.617054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 178/366] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:32.618264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:32.633945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:32.683344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:32.684839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:32.713244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:32.753811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229e373b-4148-475e-8288-82c2054bb3be None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:32.797048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:32.798222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:32.800193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:32.800770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:32.813818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:32.817119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 189/367] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:32.818169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:32.827946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:32.829080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:32.830605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:32.833303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 179/368] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:32.834342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:32.911661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:32.961948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c0431-3627-465f-9838-b179b09ca9dc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:32.971171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59452b20-019f-4208-b91e-c19fe9823a41 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.008730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.009594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.010154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.012140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.012262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] RBAC: Adding query filter params (role.id=2056b78da4104febafaea3f956d1fe6c, user.id=47e8595aa40543c5ab0c288c80ae2402, scope.system=all) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:33.012991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.013896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:33.015662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.022363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.023624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.024083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.024559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.026174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.029606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.033932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 180/369] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:32 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.034935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.043747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 190/370] 10.222.0.20 () {56 vars in 1308 bytes} [Thu Jun 30 12:37:32 2022] GET /identity/v3/role_assignments?user.id=47e8595aa40543c5ab0c288c80ae2402&scope.system=all&role.id=2056b78da4104febafaea3f956d1fe6c => generated 510 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.044709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.153476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d9f000-adae-4daa-90fe-0e9564e78586 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.164881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315cfb1c-5c43-4fe5-9343-2f149aded4d1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.188650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:33.194191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.195704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.196215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.196715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.198269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.199973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.202312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 181/371] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.203350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.212113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.212865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.213155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.213439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.214221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:33.214537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.215975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.231746 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 191/372] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.232676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.283865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:33.324927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7970e4-cf2a-4976-a065-0d4314bcd511 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.353214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6d744-8ad3-4215-b04c-78de2a31258d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.364747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.365967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.366450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.366909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.368360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.370049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.372201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 182/373] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.373202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.398982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.399865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.400153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.400463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.401720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.403227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.408523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 192/374] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.409886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.468481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:33.491332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5942cd0f-d39d-43aa-ac5b-5bd92323e888 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.529747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21052361-db05-4c1f-ba51-1a1c6a0e7639 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.532258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01d61a7-8000-492b-89a5-936f5df36684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.533691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d61a7-8000-492b-89a5-936f5df36684 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.534212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d61a7-8000-492b-89a5-936f5df36684 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.534692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01d61a7-8000-492b-89a5-936f5df36684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.538771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:33.569079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.569737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.570067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.570349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.571186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=ccdacc0de80446339111c9274d3fc1dc) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:33.571511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.573042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.580555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 193/375] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.581669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.622737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d61a7-8000-492b-89a5-936f5df36684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.624963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01d61a7-8000-492b-89a5-936f5df36684 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.748847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed4a5d-10be-4694-8b23-6144a26c31b0 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.769847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:33.790706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 183/376] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:33.792441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423888-dae6-4464-a206-b64f06377365 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.792996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423888-dae6-4464-a206-b64f06377365 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.793478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9423888-dae6-4464-a206-b64f06377365 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.795056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 184/377] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:33.797828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9423888-dae6-4464-a206-b64f06377365 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.813114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1aadc-2f0e-482a-bb2e-c3202900a229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.813774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1aadc-2f0e-482a-bb2e-c3202900a229 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.814226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1aadc-2f0e-482a-bb2e-c3202900a229 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.814693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1aadc-2f0e-482a-bb2e-c3202900a229 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.815777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1aadc-2f0e-482a-bb2e-c3202900a229 None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=ccdacc0de80446339111c9274d3fc1dc) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:33.816249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1aadc-2f0e-482a-bb2e-c3202900a229 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.817875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1aadc-2f0e-482a-bb2e-c3202900a229 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.824910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 194/378] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.826437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1e351-3072-450d-bd5b-8c3293bd0bba None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.826906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1e351-3072-450d-bd5b-8c3293bd0bba None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.827336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1e351-3072-450d-bd5b-8c3293bd0bba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.847244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:33.847702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-90e1e351-3072-450d-bd5b-8c3293bd0bba None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:33.849330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-90e1e351-3072-450d-bd5b-8c3293bd0bba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:33.928011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 195/379] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:33.928224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9423888-dae6-4464-a206-b64f06377365 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:33.969828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:33.971240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:33.971632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:33.971913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] PATH_INFO: `/v3/projects/164f9c2181684cbfbef84aef48504d33` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:33.973544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] RBAC: Authorizing `identity:get_project(project_id=164f9c2181684cbfbef84aef48504d33)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:33.974755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:33.975005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1e351-3072-450d-bd5b-8c3293bd0bba None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:33.976888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 185/380] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/projects/164f9c2181684cbfbef84aef48504d33 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:33.982613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:34.136770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1e351-3072-450d-bd5b-8c3293bd0bba None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:34.151123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb7055-5c56-4742-82b1-7387d011720c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:34.151986 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:34.154364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:34.194323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:34.195145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.195428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.195706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.195968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:34.197118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.197494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.197866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] PATH_INFO: `/v3/groups/fc70ce04637b4e02a6e85e2f5f6f763b` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.203431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] RBAC: Authorizing `identity:get_group(group_id=fc70ce04637b4e02a6e85e2f5f6f763b)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:34.205291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:34.207439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 186/381] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/groups/fc70ce04637b4e02a6e85e2f5f6f763b => generated 229 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:34.208614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:34.212892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:34.218607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:34.219744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:34.221183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 196/382] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:34.226579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:34.366871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dd33d1-0b7d-43ee-864a-d12999588fe0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:34.412205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68066b73-2e5d-4dee-b04b-e01e4bdc7844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:34.412821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066b73-2e5d-4dee-b04b-e01e4bdc7844 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.413111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066b73-2e5d-4dee-b04b-e01e4bdc7844 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.413391 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68066b73-2e5d-4dee-b04b-e01e4bdc7844 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.414242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68066b73-2e5d-4dee-b04b-e01e4bdc7844 None admin] RBAC: Adding query filter params (group.id=fc70ce04637b4e02a6e85e2f5f6f763b, role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=164f9c2181684cbfbef84aef48504d33) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:34.414564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68066b73-2e5d-4dee-b04b-e01e4bdc7844 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:34.416020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68066b73-2e5d-4dee-b04b-e01e4bdc7844 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:34.422372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 187/383] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:34 2022] GET /identity/v3/role_assignments?group.id=fc70ce04637b4e02a6e85e2f5f6f763b&scope.project.id=164f9c2181684cbfbef84aef48504d33&role.id=44959a301b01424ea68b1b0a25c1321f => generated 260 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:34.475825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e45734-c6a4-422d-a70f-51c542bfd322 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:34.519812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497b8d-ae5e-4e7e-a439-f95d220b2e76 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.520121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497b8d-ae5e-4e7e-a439-f95d220b2e76 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.520408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57497b8d-ae5e-4e7e-a439-f95d220b2e76 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.521833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 188/384] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:34.529167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d62db-3664-4226-b199-77d5661c81fa None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.529462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d62db-3664-4226-b199-77d5661c81fa None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.529752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54d62db-3664-4226-b199-77d5661c81fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.535692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:34.536713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.537212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.537669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.538644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:34.539143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:34.540776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:34.550554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b54d62db-3664-4226-b199-77d5661c81fa None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:34.551782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b54d62db-3664-4226-b199-77d5661c81fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:34.557802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 197/385] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 327 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:34.559427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:34.592272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:34.605756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:34.672494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 189/386] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:34.714740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f39ccd-9994-43fd-8bcb-4f0aa1eef9ad None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:34.742579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d62db-3664-4226-b199-77d5661c81fa None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:34.769754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:34.770640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.770929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.771211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.773698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:34.775481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:34.782758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 198/387] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:34 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:34.784945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:34.914863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:34.921115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6f5e99-7626-4b6b-baa6-1282cd95c4bc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:34.976133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54d62db-3664-4226-b199-77d5661c81fa None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:34.987536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:34.988898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:34.989368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:34.989851 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:34.997173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:34.999001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:35.001330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 199/388] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:34 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:35.007696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:35.016143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:35.018903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:35.019370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:35.019844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:35.034483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:35.043468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:35.044552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:35.045324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:35.051781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 190/389] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:35.053346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:35.088824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:35.215332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7c566-f590-4596-b697-563e2070c7d2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:35.239791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cfa5cf-13f0-4c64-8c2c-6a4597df744a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:35.286680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:35.287573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:35.287861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:35.288144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:35.292413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcd177d0fc242728a0eeb05c6b14f0e, group_id=7d67eb23b26b47eaa66a0e44c9953fca, role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:35.293894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:35.307945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:35.308672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:35.309019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:35.309336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:35.310280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] RBAC: Adding query filter params (name=member) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:35.310601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:35.315359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:35.322406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 200/390] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 30 12:37:35 2022] PUT /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:37:35.335529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 191/391] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:35.341220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:35.396689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:35.488437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da121e9c-a696-4f01-bdfc-90ab1eeef54c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:35.538810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:35.539599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:35.539933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:35.540220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:35.545324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:35.546818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:35.554183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 201/392] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:35 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:35.559991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:35.662599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:35.690896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ec8baf-0d5f-4c81-8747-01c48b00e14f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:35.737305 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c011a-c306-4d04-9bbb-314fbb8e39f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:35.738186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c011a-c306-4d04-9bbb-314fbb8e39f4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:35.738472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c011a-c306-4d04-9bbb-314fbb8e39f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:35.738749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c011a-c306-4d04-9bbb-314fbb8e39f4 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:35.745315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c011a-c306-4d04-9bbb-314fbb8e39f4 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:35.746795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c011a-c306-4d04-9bbb-314fbb8e39f4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:35.748843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 192/393] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:35 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:35.755008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:35.863886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:35.874721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c0219c-0ac1-4fc4-9994-772f2186e695 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:35.924639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b224d25-03d6-40de-9be1-8d8b1dd1faec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:35.925534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224d25-03d6-40de-9be1-8d8b1dd1faec None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:35.925818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224d25-03d6-40de-9be1-8d8b1dd1faec None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:35.926093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b224d25-03d6-40de-9be1-8d8b1dd1faec None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:35.928096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b224d25-03d6-40de-9be1-8d8b1dd1faec None admin] RBAC: Authorizing `identity:create_grant(project_id=fbcd177d0fc242728a0eeb05c6b14f0e, group_id=7d67eb23b26b47eaa66a0e44c9953fca, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:35.929622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b224d25-03d6-40de-9be1-8d8b1dd1faec None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:35.952745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 202/394] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 30 12:37:35 2022] PUT /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:36.357023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb13c1-ebaa-491d-9252-4a6da7a0e65e None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:36.357526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb13c1-ebaa-491d-9252-4a6da7a0e65e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:36.357628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb13c1-ebaa-491d-9252-4a6da7a0e65e None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:36.359305 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 193/395] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:36.364853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1b44-c36e-4f9e-a5ed-6c2ebb2d33e0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:36.365139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1b44-c36e-4f9e-a5ed-6c2ebb2d33e0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:36.365415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3e1b44-c36e-4f9e-a5ed-6c2ebb2d33e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:36.386817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-cf3e1b44-c36e-4f9e-a5ed-6c2ebb2d33e0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:36.388208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cf3e1b44-c36e-4f9e-a5ed-6c2ebb2d33e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:36.479527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 203/396] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:36.496319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f64b-2470-460b-b652-1a2767db53ff None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:36.496649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f64b-2470-460b-b652-1a2767db53ff None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:36.496917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817f64b-2470-460b-b652-1a2767db53ff None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:36.498292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 194/397] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:36.511344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38512-1ffb-446b-bfad-36fd23da2a63 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:36.511832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38512-1ffb-446b-bfad-36fd23da2a63 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:36.511907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c38512-1ffb-446b-bfad-36fd23da2a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:36.513373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f64b-2470-460b-b652-1a2767db53ff None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:36.543469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-87c38512-1ffb-446b-bfad-36fd23da2a63 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:36.544803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-87c38512-1ffb-446b-bfad-36fd23da2a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:36.649157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 204/398] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:36.678760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38512-1ffb-446b-bfad-36fd23da2a63 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:36.697002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:36.746829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817f64b-2470-460b-b652-1a2767db53ff None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:36.796145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c38512-1ffb-446b-bfad-36fd23da2a63 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:36.833060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:36.834227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:36.834523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:36.834807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:36.846754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:36.855218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:36.856150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:36.857411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 205/399] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:36.862490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:36.868156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:36.869012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:36.869299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:36.869580 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:36.910066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:36.923835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:36.924956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:36.925819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:36.926417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 195/400] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 413 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:36.933280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:36.965319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:36.967274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:36.996700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0c7aa6-e781-4260-8a17-7f8884b0e005 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.067670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.068343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.068651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.068927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.069681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:37.069990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:37.071360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:37.092920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 206/401] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:37.094913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.148301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c7f6bb-b9e2-4a0c-90fd-bba3b4210013 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.211746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef425c8-93a6-4c4d-8797-d45fd3138637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.212672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef425c8-93a6-4c4d-8797-d45fd3138637 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.212966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef425c8-93a6-4c4d-8797-d45fd3138637 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.213515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef425c8-93a6-4c4d-8797-d45fd3138637 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.214280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef425c8-93a6-4c4d-8797-d45fd3138637 None admin] RBAC: Adding query filter params (name=member) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:37.214594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef425c8-93a6-4c4d-8797-d45fd3138637 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:37.216133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef425c8-93a6-4c4d-8797-d45fd3138637 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:37.226894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 196/402] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:37.232947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b5a0-21a3-4922-a96e-09f83da268ac None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.233249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b5a0-21a3-4922-a96e-09f83da268ac None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.233532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c6b5a0-21a3-4922-a96e-09f83da268ac None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.235033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 197/403] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:37.238520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b5a0-21a3-4922-a96e-09f83da268ac None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.269062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea5eb1a-001b-4806-b432-f43d4828f7fb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.319386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648673f-dcbf-4129-9a9c-e94a36fc2978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.320608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648673f-dcbf-4129-9a9c-e94a36fc2978 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.320903 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648673f-dcbf-4129-9a9c-e94a36fc2978 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.321191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648673f-dcbf-4129-9a9c-e94a36fc2978 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.322775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648673f-dcbf-4129-9a9c-e94a36fc2978 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:37.325052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648673f-dcbf-4129-9a9c-e94a36fc2978 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:37.332195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 207/404] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:37 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:37.332195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba52f-f054-43f6-bc75-6736fd8b582b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.332195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba52f-f054-43f6-bc75-6736fd8b582b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.332195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ba52f-f054-43f6-bc75-6736fd8b582b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.341916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:37.352065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:37.359584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a87ba52f-f054-43f6-bc75-6736fd8b582b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:37.361853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a87ba52f-f054-43f6-bc75-6736fd8b582b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:37.386768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c6b5a0-21a3-4922-a96e-09f83da268ac None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.435768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.436669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.437427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.437717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.439177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:37.440705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:37.446612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 198/405] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:37 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:37.446612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.446832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 208/406] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:37.448359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ba52f-f054-43f6-bc75-6736fd8b582b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.573896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ba52f-f054-43f6-bc75-6736fd8b582b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.584322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb8a7d-c0c7-4f6e-a80c-73a4ee2826df None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.609908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.610789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.611189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.611481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.613111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:37.615087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:37.617660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 209/407] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:37 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:37.618881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.622214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:37.628844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.632028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.632932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.633436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.635067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:37.636895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:37.639380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 199/408] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:37 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:37.640609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.654484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:37.749447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b456946-f7ae-434c-9911-26301e57e88c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.768832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3a85b-2640-4c5f-9620-09f6781182da None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:37.789454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.790713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.791194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.791689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.803882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:37.805727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:37.806612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:37.806896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:37.807174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:37.809255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] RBAC: Authorizing `identity:create_grant(project_id=ccdacc0de80446339111c9274d3fc1dc, group_id=7d67eb23b26b47eaa66a0e44c9953fca, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:37.810699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:37.813947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:37.815743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:37.816575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:37.822922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 210/409] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:37.822922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.840376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 200/410] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 30 12:37:37 2022] PUT /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:37.842460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:37.913529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:37.962326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:37.965670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2907959-cb0b-403f-9843-fa375f69b3f8 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.008486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a2dd70-596e-4d0e-afdf-4d65693f5acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.008992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c9fcc8-592d-45f9-ad76-3c6ace7571de None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.009452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2dd70-596e-4d0e-afdf-4d65693f5acd None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.009750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2dd70-596e-4d0e-afdf-4d65693f5acd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.010035 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a2dd70-596e-4d0e-afdf-4d65693f5acd None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.014635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2dd70-596e-4d0e-afdf-4d65693f5acd None admin] RBAC: Authorizing `identity:create_grant(project_id=ccdacc0de80446339111c9274d3fc1dc, group_id=7d67eb23b26b47eaa66a0e44c9953fca, role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:38.017566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a2dd70-596e-4d0e-afdf-4d65693f5acd None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:38.036530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 211/411] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 30 12:37:37 2022] PUT /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc/groups/7d67eb23b26b47eaa66a0e44c9953fca/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:38.039435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea02c3-22cc-4a64-837f-244a460ccf38 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.039728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea02c3-22cc-4a64-837f-244a460ccf38 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.040010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bea02c3-22cc-4a64-837f-244a460ccf38 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.041815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 212/412] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:38.047600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61398c-b70c-4b67-a03a-5f1da61ee40e None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.048024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61398c-b70c-4b67-a03a-5f1da61ee40e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.049302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce61398c-b70c-4b67-a03a-5f1da61ee40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.055761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.057637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.058115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.058590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.059667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:38.060217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:38.061907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:38.070687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-ce61398c-b70c-4b67-a03a-5f1da61ee40e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:38.073234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ce61398c-b70c-4b67-a03a-5f1da61ee40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:38.075321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 201/413] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:38.082789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:38.163654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 213/414] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:38.197342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba52b022-090e-439c-bbd4-79401df52486 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.200462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61398c-b70c-4b67-a03a-5f1da61ee40e None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:38.230402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:38.236632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.238188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.238916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.239527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] PATH_INFO: `/v3/groups/fc70ce04637b4e02a6e85e2f5f6f763b` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.248478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] RBAC: Authorizing `identity:get_group(group_id=fc70ce04637b4e02a6e85e2f5f6f763b)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:38.248478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:38.248478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 202/415] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:38 2022] GET /identity/v3/groups/fc70ce04637b4e02a6e85e2f5f6f763b => generated 229 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:38.253935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:38.313699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:38.374489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938219c0-35cb-4bc3-88f0-fc6b28eff867 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.386553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce61398c-b70c-4b67-a03a-5f1da61ee40e None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.415974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.417427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.417716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.418002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] PATH_INFO: `/v3/projects/164f9c2181684cbfbef84aef48504d33` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.419227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] RBAC: Authorizing `identity:get_project(project_id=164f9c2181684cbfbef84aef48504d33)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:38.420711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:38.424970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 203/416] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:38 2022] GET /identity/v3/projects/164f9c2181684cbfbef84aef48504d33 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:37:38.427653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d71f-966e-4062-9441-418517043842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.428565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d71f-966e-4062-9441-418517043842 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.428855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d71f-966e-4062-9441-418517043842 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.429133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f140d71f-966e-4062-9441-418517043842 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.429634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:38.441325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f140d71f-966e-4062-9441-418517043842 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f140d71f-966e-4062-9441-418517043842 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:38.451105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:38.451972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:38.452817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 214/417] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:38.458117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d71f-966e-4062-9441-418517043842 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:38.520430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:38.573143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce03b312-eb3f-4b5e-a654-6583504470ad None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.580541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f140d71f-966e-4062-9441-418517043842 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.612768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:38.635419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.636307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.636614 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.636891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] PATH_INFO: `/v3/projects/164f9c2181684cbfbef84aef48504d33/groups/fc70ce04637b4e02a6e85e2f5f6f763b/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.638883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] RBAC: Authorizing `identity:create_grant(project_id=164f9c2181684cbfbef84aef48504d33, group_id=fc70ce04637b4e02a6e85e2f5f6f763b, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:38.640330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:38.664166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 204/418] 10.222.0.20 () {58 vars in 1442 bytes} [Thu Jun 30 12:37:38 2022] PUT /identity/v3/projects/164f9c2181684cbfbef84aef48504d33/groups/fc70ce04637b4e02a6e85e2f5f6f763b/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:38.671977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb0af9-56f0-432c-8468-f7b3f5701843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.671977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0af9-56f0-432c-8468-f7b3f5701843 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.671977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0af9-56f0-432c-8468-f7b3f5701843 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.671977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb0af9-56f0-432c-8468-f7b3f5701843 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.672339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb0af9-56f0-432c-8468-f7b3f5701843 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:38.672339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb0af9-56f0-432c-8468-f7b3f5701843 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:38.672339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eb0af9-56f0-432c-8468-f7b3f5701843 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:38.683232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 215/419] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:38.688829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:38.776888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f057-e85c-453e-8e1f-4022184a9332 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.777231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f057-e85c-453e-8e1f-4022184a9332 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.777501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9041f057-e85c-453e-8e1f-4022184a9332 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.779811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 216/420] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:38.791060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa2b0-76a8-4341-9a93-59ace60cda6e None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.791379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa2b0-76a8-4341-9a93-59ace60cda6e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.791631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa2b0-76a8-4341-9a93-59ace60cda6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.810178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-27eaa2b0-76a8-4341-9a93-59ace60cda6e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:38.811416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-27eaa2b0-76a8-4341-9a93-59ace60cda6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:38.816009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4cedc-efc6-4152-8789-e5ba76ed5114 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:38.851967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:38.867446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:38.868124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:38.868678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:38.868784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:38.912093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 217/421] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:38.951985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaa2b0-76a8-4341-9a93-59ace60cda6e None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:38.976562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:38.978452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:39.065315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaa2b0-76a8-4341-9a93-59ace60cda6e None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:39.067817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:39.094224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 205/422] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:39.105466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:39.108260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:39.109831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:39.109831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:39.109831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:39.122586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:39.131435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:39.132438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:39.133490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 218/423] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:39.138590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:39.139671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:39.246829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4514db5-adc2-4171-b634-9e8206b52b28 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:39.276332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d261b9c-a960-43cf-b973-32012d555f39 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:39.317172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:39.318062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:39.318347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:39.318627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:39.319963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:39.321518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:39.324034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 206/424] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:39 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:39.329319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:39.330814 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:39.331095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:39.331461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:39.332262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:39.332668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:39.334096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:39.345499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:39.345844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 219/425] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:39.351294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:39.388775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:39.489480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:39.495865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94480762-f627-4051-bcc6-6d561e2b806a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:39.507077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af3b69b-2509-4dfd-9fb1-1b262df28a11 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:39.562810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:39.563677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:39.563963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:39.564325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:39.565855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:39.567984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:39.570095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 207/426] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:39 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:39.577817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:39.585911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:39.586567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:39.586864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:39.587108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:39.713764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:39.715485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:39.762754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6791db48-5311-4c34-a638-a37469e22a46 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:39.772215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:39.820675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:39.821346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:39.821642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:39.821924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:39.822777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:39.823100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:39.825553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:39.840074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 208/427] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:39 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 611 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:39.919322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 220/428] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:39.926408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:39.985624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:40.073134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9d6d8c-0654-492b-b550-026cb0863991 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:40.110166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:40.112013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.112674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.113125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] PATH_INFO: `/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.114562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] RBAC: Authorizing `identity:get_project(project_id=fbcd177d0fc242728a0eeb05c6b14f0e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:40.116182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:40.118391 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 209/429] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:39 2022] GET /identity/v3/projects/fbcd177d0fc242728a0eeb05c6b14f0e => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:40.124534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:40.238939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdb5794-eca7-4d74-a0ba-ba2aa285c8e5 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:40.279863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57ec1e-5a5c-43ed-b8b8-929bbc261822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:40.281067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ec1e-5a5c-43ed-b8b8-929bbc261822 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.281527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ec1e-5a5c-43ed-b8b8-929bbc261822 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.281971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57ec1e-5a5c-43ed-b8b8-929bbc261822 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.283642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ec1e-5a5c-43ed-b8b8-929bbc261822 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:40.285412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57ec1e-5a5c-43ed-b8b8-929bbc261822 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:40.287322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:40.287746 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 221/430] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:40 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:40.296429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:40.387012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da51e5-873b-4001-9462-dbf64c9482b1 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.388183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da51e5-873b-4001-9462-dbf64c9482b1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.388689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29da51e5-873b-4001-9462-dbf64c9482b1 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.390891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 222/431] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:40.397153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce93e2-f2dd-4f24-b7e6-d7ca387e54e7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.397698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce93e2-f2dd-4f24-b7e6-d7ca387e54e7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.398174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdce93e2-f2dd-4f24-b7e6-d7ca387e54e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.416276 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bdce93e2-f2dd-4f24-b7e6-d7ca387e54e7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:40.417959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bdce93e2-f2dd-4f24-b7e6-d7ca387e54e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:40.418563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:40.426225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c36762-65af-4a5c-a99c-bc4e04b490e5 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:40.463072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:40.463735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.464026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.464312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.465384 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:40.465711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:40.467164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:40.480534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 210/432] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:40 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=fbcd177d0fc242728a0eeb05c6b14f0e&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 611 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:40.501556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 223/433] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:40.527889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:40.659900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb9b6e-ee15-4998-9ceb-0466af4452fe None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:40.705413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528af21-8abe-475c-b2b7-914d951d976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:40.706554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528af21-8abe-475c-b2b7-914d951d976d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.707054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528af21-8abe-475c-b2b7-914d951d976d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.707522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528af21-8abe-475c-b2b7-914d951d976d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.718932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528af21-8abe-475c-b2b7-914d951d976d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-d528af21-8abe-475c-b2b7-914d951d976d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:40.726695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:40.727608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:40.728853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 211/434] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:40.733973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce93e2-f2dd-4f24-b7e6-d7ca387e54e7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:40.744859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bcef-5fe7-4277-a19e-897fb5df2bd8 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.745466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bcef-5fe7-4277-a19e-897fb5df2bd8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.745959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0bcef-5fe7-4277-a19e-897fb5df2bd8 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.747361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 212/435] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:40.754393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bfae-38d9-432b-830f-24c96183f558 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.754920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bfae-38d9-432b-830f-24c96183f558 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.755421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d73bfae-38d9-432b-830f-24c96183f558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.781436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2d73bfae-38d9-432b-830f-24c96183f558 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:40.782990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2d73bfae-38d9-432b-830f-24c96183f558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:40.801867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:40.872064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 213/436] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:40.881491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdce93e2-f2dd-4f24-b7e6-d7ca387e54e7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:40.897189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bfae-38d9-432b-830f-24c96183f558 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:40.912714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:40.928690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:40.929735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:40.930297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:40.930878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:40.931839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] RBAC: Adding query filter params (name=member) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:40.932339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:40.933751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:40.943553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 224/437] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:37:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:40.948854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.038729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d73bfae-38d9-432b-830f-24c96183f558 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.081472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.082299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.082587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.082869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.089321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95962962-c122-40b3-816a-4f40a5ee88fa None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.101383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:41.109804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:41.110750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:41.111668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 214/438] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:41.119824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.136230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.141103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5389e53-7d2d-4846-9e0f-239844019b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.143730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389e53-7d2d-4846-9e0f-239844019b14 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.144023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389e53-7d2d-4846-9e0f-239844019b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.144311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5389e53-7d2d-4846-9e0f-239844019b14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.211868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.226255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389e53-7d2d-4846-9e0f-239844019b14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:41.227708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5389e53-7d2d-4846-9e0f-239844019b14 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:41.248780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec7ebe1-3d51-40dd-950c-93017fa7d75a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.296735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f5b91-377a-43fd-bb40-21c5b86cbf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.297404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5b91-377a-43fd-bb40-21c5b86cbf40 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.297685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5b91-377a-43fd-bb40-21c5b86cbf40 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.297963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f5b91-377a-43fd-bb40-21c5b86cbf40 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.298919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5b91-377a-43fd-bb40-21c5b86cbf40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:41.299234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5b91-377a-43fd-bb40-21c5b86cbf40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:41.300645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f5b91-377a-43fd-bb40-21c5b86cbf40 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:41.308752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 215/439] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:41.310099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed799-dce3-40ba-89b0-67c9a51ff57f None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.310460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed799-dce3-40ba-89b0-67c9a51ff57f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.310754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906ed799-dce3-40ba-89b0-67c9a51ff57f None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.311983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 216/440] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:41.314825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed799-dce3-40ba-89b0-67c9a51ff57f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.345550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 225/441] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 12:37:41.346825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eef5ef-1809-41d7-9814-56a53febf924 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.347119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eef5ef-1809-41d7-9814-56a53febf924 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.347403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eef5ef-1809-41d7-9814-56a53febf924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.363120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f8eef5ef-1809-41d7-9814-56a53febf924 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:41.364344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f8eef5ef-1809-41d7-9814-56a53febf924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:41.391943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.423647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906ed799-dce3-40ba-89b0-67c9a51ff57f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.435135 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 226/442] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:41.435988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eef5ef-1809-41d7-9814-56a53febf924 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.453853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.461638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.462359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.462568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.462849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.530765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:41.532229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:41.538236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eef5ef-1809-41d7-9814-56a53febf924 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.573167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.574028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.574311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.574587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.575775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:41.577287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:41.578955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 227/443] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:41.580365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.603260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.636129 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 217/444] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:41.637322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.671823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.688576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15eeeee-468a-4c51-b185-784d0417f8de None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.724688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.725481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.725763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.726047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.736456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:41.744123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:41.745277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:37:41.746086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:41.746701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c72a6-8ee4-47e0-8c58-c308e73a42b4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.746773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 228/445] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:41.746773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.790856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.791688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.791979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.792272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.793547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:41.795010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:41.796740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 218/446] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:41.797525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.840040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.854093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f72f-667e-4a38-91ba-e322ee43d11d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.888754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.889610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.889897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.890205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] PATH_INFO: `/v3/projects/ccdacc0de80446339111c9274d3fc1dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.891384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] RBAC: Authorizing `identity:get_project(project_id=ccdacc0de80446339111c9274d3fc1dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:41.893254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:41.894927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 229/447] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/projects/ccdacc0de80446339111c9274d3fc1dc => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:41.895684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.903236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee2f0c9-6f4e-4b0d-879d-4afd95d47c6d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:41.911321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:41.937827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:41.938489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:41.938775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:41.939128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:41.940430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:41.940740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:41.942153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:41.954591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 219/448] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:41.954591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:41.999381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559b0300-480d-4e90-8ae7-249bb40d941f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:42.041671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:42.042331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:42.042620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:42.042900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:42.043739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=60b18f6f37f34c88be6d03d808bc0d04, scope.project.id=ccdacc0de80446339111c9274d3fc1dc) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:42.044058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:42.045541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:42.051942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 230/449] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=60b18f6f37f34c88be6d03d808bc0d04 => generated 611 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:42.052808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:42.062858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285fc8b7-68db-43ff-b86f-d0727bb6767e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:42.065850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:42.107532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:42.108565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:42.108940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:42.109290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] PATH_INFO: `/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:42.110730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] RBAC: Authorizing `identity:get_group(group_id=7d67eb23b26b47eaa66a0e44c9953fca)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:42.112523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:42.114269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 220/450] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:41 2022] GET /identity/v3/groups/7d67eb23b26b47eaa66a0e44c9953fca => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:42.121231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:42.166806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:42.196700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c631f49-6caa-4cf2-98dc-1645bb37c016 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:42.241174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:42.241844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:42.242136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:42.242415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:42.250356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16d4bbf-35b3-4966-8b1b-3bf9cb114a92 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:42.294799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:42.295252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:42.295542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:42.295937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:42.296824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] RBAC: Adding query filter params (group.id=7d67eb23b26b47eaa66a0e44c9953fca, role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=ccdacc0de80446339111c9274d3fc1dc) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:42.298506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:42.300539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:42.307064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 221/451] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:42 2022] GET /identity/v3/role_assignments?group.id=7d67eb23b26b47eaa66a0e44c9953fca&scope.project.id=ccdacc0de80446339111c9274d3fc1dc&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:42.331099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:42.333588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:42.445106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:42.475170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 231/452] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:42.481184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:42.516442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:42.604280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f943b30-4212-4893-a041-92001c6a2dc1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:42.652679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:42.653558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:42.653848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:42.654134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] PATH_INFO: `/v3/projects/164f9c2181684cbfbef84aef48504d33` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:42.655525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] RBAC: Authorizing `identity:get_project(project_id=164f9c2181684cbfbef84aef48504d33)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:42.657038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:42.659454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 222/453] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:37:42 2022] GET /identity/v3/projects/164f9c2181684cbfbef84aef48504d33 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:42.668438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:42.787391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3b37a0-49b2-4b40-986c-ae3366d2fd5d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:42.821580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c62dd9-2965-4e7d-a0eb-267208b9fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:42.822434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62dd9-2965-4e7d-a0eb-267208b9fad3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:42.822713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62dd9-2965-4e7d-a0eb-267208b9fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:42.822983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c62dd9-2965-4e7d-a0eb-267208b9fad3 None admin] PATH_INFO: `/v3/groups/fc70ce04637b4e02a6e85e2f5f6f763b` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:42.824140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62dd9-2965-4e7d-a0eb-267208b9fad3 None admin] RBAC: Authorizing `identity:get_group(group_id=fc70ce04637b4e02a6e85e2f5f6f763b)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:42.825611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c62dd9-2965-4e7d-a0eb-267208b9fad3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:42.827245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 232/454] 10.222.0.20 () {56 vars in 1180 bytes} [Thu Jun 30 12:37:42 2022] GET /identity/v3/groups/fc70ce04637b4e02a6e85e2f5f6f763b => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:42.833567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:42.943263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e35572f-f7a3-46c4-96c4-28d604dd4e38 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:42.944825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:42.978086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a1b83-0670-4b23-95e9-233c25dced8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:42.978733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1b83-0670-4b23-95e9-233c25dced8f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:42.979022 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1b83-0670-4b23-95e9-233c25dced8f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:42.979305 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1b83-0670-4b23-95e9-233c25dced8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:42.980140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a1b83-0670-4b23-95e9-233c25dced8f None admin] RBAC: Adding query filter params (group.id=fc70ce04637b4e02a6e85e2f5f6f763b, role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=164f9c2181684cbfbef84aef48504d33) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:42.980482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a1b83-0670-4b23-95e9-233c25dced8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:42.981935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250a1b83-0670-4b23-95e9-233c25dced8f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:42.988341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 223/455] 10.222.0.20 () {56 vars in 1376 bytes} [Thu Jun 30 12:37:42 2022] GET /identity/v3/role_assignments?group.id=fc70ce04637b4e02a6e85e2f5f6f763b&scope.project.id=164f9c2181684cbfbef84aef48504d33&role.id=44959a301b01424ea68b1b0a25c1321f => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:45.449561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6381f-d225-40da-92bd-7873721ac38b None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:45.450613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6381f-d225-40da-92bd-7873721ac38b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:45.451124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6381f-d225-40da-92bd-7873721ac38b None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:45.453159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 233/456] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:45.460143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e9b3-d178-4892-b7ea-9a777a1eb493 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:45.461205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e9b3-d178-4892-b7ea-9a777a1eb493 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:45.461678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b88e9b3-d178-4892-b7ea-9a777a1eb493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:45.487858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1b88e9b3-d178-4892-b7ea-9a777a1eb493 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:45.489487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1b88e9b3-d178-4892-b7ea-9a777a1eb493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:45.587776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 224/457] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:45.628204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6381f-d225-40da-92bd-7873721ac38b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:45.695970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:45.778187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6381f-d225-40da-92bd-7873721ac38b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:45.826463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd4ea23-176e-48b5-954e-277117d0c7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:45.827275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4ea23-176e-48b5-954e-277117d0c7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:45.827559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4ea23-176e-48b5-954e-277117d0c7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:45.827835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd4ea23-176e-48b5-954e-277117d0c7d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:45.843734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4ea23-176e-48b5-954e-277117d0c7d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:45.845778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd4ea23-176e-48b5-954e-277117d0c7d4 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-9fd4ea23-176e-48b5-954e-277117d0c7d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:45.868608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:45.869548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:45.870409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:45.870409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:45.870409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:45.870409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:45.870409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 234/458] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:45.875705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88e9b3-d178-4892-b7ea-9a777a1eb493 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:45.896964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02397-b528-44da-827a-797af68bef19 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:45.897295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02397-b528-44da-827a-797af68bef19 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:45.897532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f02397-b528-44da-827a-797af68bef19 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:45.899162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 235/459] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:45.904204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700976f-027d-4f31-8fa6-2e282c6f491b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:45.904532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700976f-027d-4f31-8fa6-2e282c6f491b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:45.904814 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700976f-027d-4f31-8fa6-2e282c6f491b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:45.926779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3700976f-027d-4f31-8fa6-2e282c6f491b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:45.927987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3700976f-027d-4f31-8fa6-2e282c6f491b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:46.037974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 236/460] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:46.062240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:46.063202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0495-310b-4785-b382-2cc3f2e14082 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.063630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0495-310b-4785-b382-2cc3f2e14082 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.064045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ed0495-310b-4785-b382-2cc3f2e14082 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.069697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 237/461] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:46.072231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3547-10b9-4f72-9efc-114da01ef5b3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.072684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3547-10b9-4f72-9efc-114da01ef5b3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.073065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d3547-10b9-4f72-9efc-114da01ef5b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.075313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b88e9b3-d178-4892-b7ea-9a777a1eb493 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.098292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a58d3547-10b9-4f72-9efc-114da01ef5b3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:46.099493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a58d3547-10b9-4f72-9efc-114da01ef5b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:46.118918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:46.119603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.119893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.120175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.120935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:46.121249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:46.122647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:46.122745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:46.136309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 225/462] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:46.137194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.184472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 238/463] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:46.185905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420c740-75e6-44bf-b045-3055bfe00755 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.186198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420c740-75e6-44bf-b045-3055bfe00755 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.186477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3420c740-75e6-44bf-b045-3055bfe00755 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.187911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 239/464] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:46.192558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420c740-75e6-44bf-b045-3055bfe00755 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.260816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce182e7-cf40-4233-9c5f-ef6b09674b9d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.300138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912edb9-3ce6-42d8-a07c-fb28282ff3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:46.300888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912edb9-3ce6-42d8-a07c-fb28282ff3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.301181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912edb9-3ce6-42d8-a07c-fb28282ff3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.301463 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912edb9-3ce6-42d8-a07c-fb28282ff3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.312458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912edb9-3ce6-42d8-a07c-fb28282ff3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:46.312643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3420c740-75e6-44bf-b045-3055bfe00755 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.313985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a912edb9-3ce6-42d8-a07c-fb28282ff3b4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a912edb9-3ce6-42d8-a07c-fb28282ff3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:46.332868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:46.333795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:46.334632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:46.334632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:46.334632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:46.334632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:46.334632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 226/465] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:46.340120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2e985-26ad-4f93-a4c8-2c6c427b162e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.340444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2e985-26ad-4f93-a4c8-2c6c427b162e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.340735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2e985-26ad-4f93-a4c8-2c6c427b162e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.350165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:46.350845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.351139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.351481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.352130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:46.353614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:46.357998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6ed2e985-26ad-4f93-a4c8-2c6c427b162e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:46.359200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6ed2e985-26ad-4f93-a4c8-2c6c427b162e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:46.362071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:46.388797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 240/466] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:46 2022] POST /identity/v3/users => generated 246 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:46.390808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.414877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:46.452876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 227/467] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:46.453974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2e985-26ad-4f93-a4c8-2c6c427b162e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.546313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01b1a5-e405-49b6-b65a-64689695a16c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.581176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2e985-26ad-4f93-a4c8-2c6c427b162e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.594260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:46.594945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.596690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.597045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.610519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:46.614006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:46.627616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:46.628302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.628641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.628919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.629659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:46.629967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:46.631352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:46.636613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:46.637504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:46.638877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:46.638877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:46.638877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:46.638877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:46.638877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 241/468] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:46.639319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.641064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:46.651642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 228/469] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:46.653481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.719259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:46.764287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae968aa-1676-418e-847d-74ca97c2daa3 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.804506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628a400-0e64-40be-9855-18381a2cef81 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.805951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:46.806929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.807316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.807725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.820661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:46.822305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:46.841681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:46.842738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:46.843776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:46.843776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:46.843776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:46.843776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:46.846453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 242/470] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:46.847508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.851326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:46.853020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:46.856686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:46.857399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:46.859000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:46.859520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:46.861799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:46.882395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 229/471] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:46.883895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:46.967862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:46.976016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72014edb-900e-42e0-b05d-ded2301b08e8 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:46.993675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:47.013305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:47.014091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.014456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.014812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.015629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:47.017605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1abdbe3-1ddb-4460-be7e-804ef59ffa9d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:47.017784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:47.041658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 243/472] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:46 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:47.042628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:47.085310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:47.085994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.086331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.086616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.087359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:47.087673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:47.089323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:47.118010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 230/473] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:47.124671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:47.185139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda4b16f-dd7c-4528-8259-dd785467ce5e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:47.231520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f523dc-356e-4ba7-a54e-e7f0c3c094cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:47.232023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f523dc-356e-4ba7-a54e-e7f0c3c094cb None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.232313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f523dc-356e-4ba7-a54e-e7f0c3c094cb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.233188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f523dc-356e-4ba7-a54e-e7f0c3c094cb None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.234207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f523dc-356e-4ba7-a54e-e7f0c3c094cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:47.236845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f523dc-356e-4ba7-a54e-e7f0c3c094cb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:47.281215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 244/474] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:47 2022] POST /identity/v3/users => generated 248 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:47.298060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb9e08-0c35-4d27-b36a-3a3eec2981ca None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.298483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb9e08-0c35-4d27-b36a-3a3eec2981ca None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.298774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb9e08-0c35-4d27-b36a-3a3eec2981ca None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.300579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 245/475] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:37:47.309658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62144-931a-4acc-ac98-02ea4478e0b0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.309968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62144-931a-4acc-ac98-02ea4478e0b0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.310239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc62144-931a-4acc-ac98-02ea4478e0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.325204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2858c5a-ebd0-4007-9b93-9fcfcf83ba4f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:47.348233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:47.349586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-efc62144-931a-4acc-ac98-02ea4478e0b0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:47.351012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-efc62144-931a-4acc-ac98-02ea4478e0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:47.371045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:47.371655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.371991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.372282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.373093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:47.374705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:47.404484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:47.412154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 231/476] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:47 2022] POST /identity/v3/users => generated 249 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:37:47.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 246/477] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:37:47.493140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:47.623718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111ec627-5630-402e-ba2d-a97dd18093b0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:47.676946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:47.678055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.678653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.679138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.680156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:47.681922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:47.690054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.sql.core [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 12:37:47.690054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 12:37:47.690054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [parameters: {'id': '1f85e240d1eb48f8885353502c867fd5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 12:37:47.690054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80103) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application conn.query(q) Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result.read() Jun 30 12:37:47.708670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return ref.to_dict() Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 12:37:47.709585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application next(self.gen) Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application yield resource Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application next(self.gen) Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise self.value Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application session.commit() Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 12:37:47.710606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.session.flush() Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application compat.raise_( Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 12:37:47.711492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 12:37:47.712370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application conn.query(q) Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result.read() Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 12:37:47.713232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [parameters: {'id': '1f85e240d1eb48f8885353502c867fd5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:47.714041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 30 12:37:47.714832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:47.717920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 232/478] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 30 12:37:47 2022] POST /identity/v3/roles => generated 144 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:47.719153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62144-931a-4acc-ac98-02ea4478e0b0 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:47.847974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc62144-931a-4acc-ac98-02ea4478e0b0 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:47.907406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774f7f4d-125d-40ce-9ead-abb4b4985d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:47.908299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f7f4d-125d-40ce-9ead-abb4b4985d09 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:47.908620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f7f4d-125d-40ce-9ead-abb4b4985d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:47.908906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774f7f4d-125d-40ce-9ead-abb4b4985d09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:47.931514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774f7f4d-125d-40ce-9ead-abb4b4985d09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-774f7f4d-125d-40ce-9ead-abb4b4985d09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:47.941679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:47.942617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:47.943470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 247/479] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:37:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:47.948944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:48.010752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:48.096886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ec2abf-de5f-4b76-979d-bdbaaf356f94 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:48.146152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bd6252-3a2d-4975-8419-a7961d636adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:48.146851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6252-3a2d-4975-8419-a7961d636adf None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:48.147141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6252-3a2d-4975-8419-a7961d636adf None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:48.147423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bd6252-3a2d-4975-8419-a7961d636adf None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:48.148200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6252-3a2d-4975-8419-a7961d636adf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:48.148557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6252-3a2d-4975-8419-a7961d636adf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:48.149967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bd6252-3a2d-4975-8419-a7961d636adf None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:48.159986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 233/480] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:48.758656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b4f2-e694-4918-b638-564e7fa0905c None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:48.759165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b4f2-e694-4918-b638-564e7fa0905c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:48.759271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab18b4f2-e694-4918-b638-564e7fa0905c None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:48.760874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 248/481] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:48.769208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8a84-6e1e-4441-88d2-bdd9fcdcc754 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:48.770168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8a84-6e1e-4441-88d2-bdd9fcdcc754 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:48.770651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8a84-6e1e-4441-88d2-bdd9fcdcc754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:48.789661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f5bb8a84-6e1e-4441-88d2-bdd9fcdcc754 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:48.791224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f5bb8a84-6e1e-4441-88d2-bdd9fcdcc754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:48.888085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 234/482] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:48.914142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b4f2-e694-4918-b638-564e7fa0905c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:48.935911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:49.047380 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab18b4f2-e694-4918-b638-564e7fa0905c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:49.083764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:49.084935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:49.085425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:49.085897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:49.097995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:49.106760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:49.107658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:49.108491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:49.115750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 249/483] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:49.117794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8a84-6e1e-4441-88d2-bdd9fcdcc754 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:49.149197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:49.233073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8a84-6e1e-4441-88d2-bdd9fcdcc754 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:49.270647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:49.271673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:49.272164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:49.272666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:49.273641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:49.274145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:49.275715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:49.290166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 235/484] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:49.291832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:49.380855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:49.401488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cf904a-b675-4ed8-85ff-9286295852dd None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:49.439890 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:49.441193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:49.441694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:49.442166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:49.453583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:49.456243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:49.475016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:49.475897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:49.476788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:49.476788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:49.476788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:49.476788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:49.479088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 250/485] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:49.485782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:49.632202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:49.643489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd55d90-963d-457c-8404-155bb37dd662 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:49.693288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:49.693288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:49.693288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:49.693288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:49.693680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:49.693680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:49.694547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:49.711843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 236/486] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:49.717140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:49.844535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867e758-2a8f-48bf-82d5-8f23c42e564c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:49.884136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:49.887754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79466d6-4330-4648-a9dc-8f1568be14b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:49.888759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79466d6-4330-4648-a9dc-8f1568be14b9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:49.889264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79466d6-4330-4648-a9dc-8f1568be14b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:49.889864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79466d6-4330-4648-a9dc-8f1568be14b9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:49.899075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79466d6-4330-4648-a9dc-8f1568be14b9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:49.900751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79466d6-4330-4648-a9dc-8f1568be14b9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f79466d6-4330-4648-a9dc-8f1568be14b9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:37:49.916586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:49.917707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:37:49.918830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:49.921119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 251/487] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:37:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:49.928419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:49.966163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157196e5-e7a7-4b10-b666-39b20549ff52 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:49.966688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157196e5-e7a7-4b10-b666-39b20549ff52 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:49.967003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157196e5-e7a7-4b10-b666-39b20549ff52 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:49.972743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 252/488] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:49.974544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b4f5-cb6d-4a25-9dbf-5c5f29f768fb None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:49.974865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b4f5-cb6d-4a25-9dbf-5c5f29f768fb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:49.975147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83b4f5-cb6d-4a25-9dbf-5c5f29f768fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:49.991999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5b83b4f5-cb6d-4a25-9dbf-5c5f29f768fb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:49.993224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5b83b4f5-cb6d-4a25-9dbf-5c5f29f768fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:50.115760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 253/489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:50.126967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996add-c0f6-43d2-90e3-890151c44c79 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:50.167697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b4f5-cb6d-4a25-9dbf-5c5f29f768fb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:50.201770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc4dc5-a367-43db-953e-2bdf52bd189b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:50.202808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4dc5-a367-43db-953e-2bdf52bd189b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.203318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4dc5-a367-43db-953e-2bdf52bd189b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.203795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc4dc5-a367-43db-953e-2bdf52bd189b None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.205423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4dc5-a367-43db-953e-2bdf52bd189b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:50.205966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4dc5-a367-43db-953e-2bdf52bd189b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:50.207631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cc4dc5-a367-43db-953e-2bdf52bd189b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:50.265955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 237/490] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:37:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:50.267993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5d62c-e1d0-4024-941a-02967efb5a8e None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.268521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5d62c-e1d0-4024-941a-02967efb5a8e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.269004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5d62c-e1d0-4024-941a-02967efb5a8e None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.270990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 238/491] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:50.276113 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5d62c-e1d0-4024-941a-02967efb5a8e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:50.290928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:50.295022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83b4f5-cb6d-4a25-9dbf-5c5f29f768fb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:50.325762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:50.344470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d87edb-630b-4cef-a9d0-b2935454f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:50.346013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87edb-630b-4cef-a9d0-b2935454f92c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.346551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87edb-630b-4cef-a9d0-b2935454f92c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.346551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d87edb-630b-4cef-a9d0-b2935454f92c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.358028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d87edb-630b-4cef-a9d0-b2935454f92c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-a1d87edb-630b-4cef-a9d0-b2935454f92c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:50.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:50.367906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:50.369658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 254/492] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:50.370329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc73cbc-13a7-4704-9424-c3c7d9eec4a0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.370329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc73cbc-13a7-4704-9424-c3c7d9eec4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.370329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc73cbc-13a7-4704-9424-c3c7d9eec4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.392548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1dc73cbc-13a7-4704-9424-c3c7d9eec4a0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:50.393869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1dc73cbc-13a7-4704-9424-c3c7d9eec4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:50.417062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf5d62c-e1d0-4024-941a-02967efb5a8e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:50.468547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:50.469577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.470644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.471192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.500476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 255/493] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:50.500476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a8a04-82ce-4af0-8293-cf712927d39d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.500476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a8a04-82ce-4af0-8293-cf712927d39d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.500476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59a8a04-82ce-4af0-8293-cf712927d39d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.500476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 256/494] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:50.500476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a8a04-82ce-4af0-8293-cf712927d39d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:50.577092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:50.578725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:50.593041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:50.637912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59a8a04-82ce-4af0-8293-cf712927d39d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:50.651801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:50.685843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f256ff8-c9bb-4c34-83e0-73979ee672af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:50.686646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256ff8-c9bb-4c34-83e0-73979ee672af None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.687009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256ff8-c9bb-4c34-83e0-73979ee672af None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.687363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256ff8-c9bb-4c34-83e0-73979ee672af None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.688209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f256ff8-c9bb-4c34-83e0-73979ee672af None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:50.688690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f256ff8-c9bb-4c34-83e0-73979ee672af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:50.692621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f256ff8-c9bb-4c34-83e0-73979ee672af None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:50.702119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 257/495] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:50.703479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac015c-1e9c-4e28-903f-4b34bbb4877a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.703779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac015c-1e9c-4e28-903f-4b34bbb4877a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.704068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac015c-1e9c-4e28-903f-4b34bbb4877a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.724192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9eac015c-1e9c-4e28-903f-4b34bbb4877a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:50.725606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9eac015c-1e9c-4e28-903f-4b34bbb4877a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:50.733374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 239/496] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:50.733374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:50.816866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 258/497] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:50.817765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac015c-1e9c-4e28-903f-4b34bbb4877a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:50.874225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2174b401-9fc5-4354-b9d9-f4c1af5d63e3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:50.891685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:50.926402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:50.927251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:50.927541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:50.927828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:50.940769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:50.948891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:50.950030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:50.950895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 240/498] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:50.951557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:50.965385 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac015c-1e9c-4e28-903f-4b34bbb4877a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:50.968647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.023895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.024948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.025394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.025679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.037640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.039086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:51.057226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:51.058305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:51.059152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:51.059152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:51.059152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.059152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:51.059152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 259/499] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:51.060134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.083780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce5589e-590b-488b-806c-362f4686d25d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.118137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.118931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.119215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.119495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.130928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.132396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:51.149806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:51.150664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:51.151503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:51.151503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:51.151503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.151503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:51.151503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 241/500] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:51.152092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.167353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf4adec-fc95-47dd-87cb-a0c78a9404e8 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.177630 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.203582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0ff941-6aea-4710-a3b9-599daecf60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.205531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ff941-6aea-4710-a3b9-599daecf60d3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.205648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ff941-6aea-4710-a3b9-599daecf60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.205934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0ff941-6aea-4710-a3b9-599daecf60d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.216491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0ff941-6aea-4710-a3b9-599daecf60d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-5a0ff941-6aea-4710-a3b9-599daecf60d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:51.224655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:51.225552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:51.226349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:51.228699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 260/501] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:51.229882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08b40-7a56-4094-9807-bc9dd29dddcc None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.230174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08b40-7a56-4094-9807-bc9dd29dddcc None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.230653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e08b40-7a56-4094-9807-bc9dd29dddcc None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.231895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 261/502] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:51.232722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08b40-7a56-4094-9807-bc9dd29dddcc None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.252798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.259473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a67bad4-f972-4599-a27d-61b45eff970a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.293773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.294369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.294659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.294943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.295703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:51.296015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.297457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.305545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 242/503] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:51.306348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.339932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e08b40-7a56-4094-9807-bc9dd29dddcc None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.373915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.374583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.374871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.375547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.375874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:51.376782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.378214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.390683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 262/504] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:51.391552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.398989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.417717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cdae19-f82a-4ffe-9d5b-9576e4dd8e7d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.462098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fda21ed-196e-4369-ab85-2b4f9dc4794d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.463200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda21ed-196e-4369-ab85-2b4f9dc4794d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.463698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda21ed-196e-4369-ab85-2b4f9dc4794d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.464180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fda21ed-196e-4369-ab85-2b4f9dc4794d None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.465493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda21ed-196e-4369-ab85-2b4f9dc4794d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:51.466041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda21ed-196e-4369-ab85-2b4f9dc4794d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.468664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fda21ed-196e-4369-ab85-2b4f9dc4794d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.474736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.490421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 243/505] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:51.492096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13f164-3a4e-4719-9611-dc5caca14064 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.492583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13f164-3a4e-4719-9611-dc5caca14064 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.492875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13f164-3a4e-4719-9611-dc5caca14064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.501017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b043ec-ce0c-4b56-b14a-9d4ef803c166 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.510169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2b13f164-3a4e-4719-9611-dc5caca14064 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:51.511418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2b13f164-3a4e-4719-9611-dc5caca14064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:51.541691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.542374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.542666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.542927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.543679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:51.544046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.545414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.555099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 263/506] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:51.555925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.585167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 244/507] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:51.586045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13f164-3a4e-4719-9611-dc5caca14064 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.663421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02195d5-4937-4686-983b-93d76d2c49a2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.676691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.702703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.703512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.703792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.704070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.707685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.708565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13f164-3a4e-4719-9611-dc5caca14064 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.717535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.718990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:51.737974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:51.739068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:51.739913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:51.739913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:51.739913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.739913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:51.739913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 264/508] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:51.740182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.747877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.748726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.749018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.749300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.758556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.760050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:37:51.777436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:51.778406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:51.779322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 245/509] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:51.779885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.848319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d447d-eed7-4605-a334-0acb9ea094c5 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.883904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.884729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.885017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.885296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.886265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa1711-07e8-4eb5-a40e-a7a61e6ca9ba None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:51.892643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.894300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:37:51.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:51.913082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 265/510] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:51.915269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.932917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:51.933735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:51.934019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:51.934300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:51.936694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:51.947468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:51.949049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:51.967294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:51.968374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:51.969518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:51.969518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:51.969518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:51.969518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:51.969518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 246/511] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:51.969518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:51.979359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:52.035985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2185f5a-3cd7-443a-af4a-c28d2ece4f4f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.071672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.072495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.072787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.073071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.075876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6279e1-d39e-4cf4-a612-cc86a1bb2da6 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.083908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.085429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:52.104684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:52.106486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:52.108171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:52.108171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:52.108171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:52.108171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:52.108171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 266/512] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:52.108171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.116583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.117293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.117579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.117860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.118604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:52.118918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.120328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.134582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 247/513] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:52.135540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.190600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:52.217543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:52.222686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67e3ff7-1ba2-4bb8-bd38-8d7c957d8b7c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.255509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76db5107-c8d1-4f01-b8b6-b5e4ed776016 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.288108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.289548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.289548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.289548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.290356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:52.291153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.292128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.294923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.295691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.296058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.296406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.297514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:52.297855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.299637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.321915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 248/514] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:52.321915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.335510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 267/515] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:52.336367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.440135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4347d7b-73ee-40fc-ad36-8439ef91523b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.447853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:52.462858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b9acf4-add8-47df-85ad-91dcaa8e1b1e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.477481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.478163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.478452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.478734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.479469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:52.479791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.481232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.494890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 249/516] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:52.495773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.534308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.535394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.535875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.536340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.537685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:52.540602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.540938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.563682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 268/517] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:52.564573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.585411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:52.623330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e69d773-c474-455c-a9a9-93dcc17e1a24 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.660013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.660840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.661127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.661406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.669324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.670808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:37:52.686097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:52.687069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:52.687967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 250/518] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:52.689207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.692009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3708fe36-0179-46ec-a633-e292554c8685 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.725601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:52.727653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.728533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.728906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.729198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.730024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=5f39f1ea697c4426b30a5e6fa795e4e4) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:52.730344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.731791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.738340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 269/519] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/role_assignments?user.id=5f39f1ea697c4426b30a5e6fa795e4e4&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:52.739143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.827908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0eb318-603d-4ebb-b6b8-6a9511bf70c8 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.849994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:52.872853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1d809e-87df-4532-a165-585088a50161 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:52.873052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.873556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.873844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.874125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.914680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:52.915489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:52.915767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:52.916044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:52.924482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.925921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:37:52.941257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:52.942391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 270/520] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:52.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:52.965365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:52.966946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:53.007486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:53.075572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c94e91c-b5d7-4f06-8a7e-944aae6aca24 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:53.099889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 251/521] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:53.099889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:53.120438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:53.121220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:53.121580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:53.121931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:53.122721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:53.124250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:53.142761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:53.150482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 271/522] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:37:52 2022] POST /identity/v3/users => generated 247 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:37:53.151515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:53.247962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272a6998-d9ff-49e0-8066-b734f6eac413 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:53.286662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:53.299916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3ec398-aed2-4088-9be5-a6b2c1c3e05e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:53.300357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:53.301480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:53.302130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:53.302565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:53.303732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:53.304249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:53.306249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:53.332084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 252/523] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jun 30 12:37:53 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:53.337402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:53.348282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:53.349001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:53.349286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:53.349567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:53.350419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:53.350728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:53.352179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:53.391268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 272/524] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 30 12:37:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:53.394359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:53.489271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:53.515009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835649a-7e35-4dc9-b641-31eb8fcd5d7d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:53.562590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:53.563395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:53.564241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:53.564893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72334f0f-2159-47a6-9577-7d03f4429a9f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:53.565276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:53.578051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:53.579616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:53.604814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:53.605767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:53.607314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:53.607314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:53.607314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:53.607314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:53.611680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 253/525] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:53.612737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:53.635547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:53.636217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:53.636537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:53.636879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:53.691724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:53.759561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:53.761127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:53.801167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2582b3d8-eaa7-40c4-826f-b03f4fbe455c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:53.839864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:53.864227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:53.865437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:53.865894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:53.866402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:53.928406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 273/526] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:53.930115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:53.983701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:53.987612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:54.053089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:54.102293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01149fe-e165-409b-bfca-a3081edba246 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:54.155411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:54.156092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:54.156407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:54.156690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:54.158529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:54.158869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:54.160726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:54.179053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 274/527] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:54.180249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:54.206189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:54.209282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 254/528] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:54.211640 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:54.363054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc3dcb9-c726-413f-999e-87637915597e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:54.364975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db4c3bd-fbd3-4c90-bac1-d9929e488eb0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:54.412133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:54.413870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:54.413981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:54.414265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:54.418088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:54.421446 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:54.422744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:54.424745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:54.425417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:54.426023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:54.427645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:54.440828 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:54.442599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:37:54.445571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:54.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:54.447311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 255/529] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:54.448880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:54.469423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:54.470859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:54.471702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:54.471702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:54.471702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:54.471702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:54.473800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 275/530] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:54.474825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:54.584944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:54.618217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05454084-8f7c-49ab-bbb9-8e209a9f6f63 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:54.667255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9261c9-f476-44b8-acfc-e32c1d34dfac None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:54.701818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:54.703437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:54.704091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:54.705799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:54.728229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:54.731191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:54.746898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:54.748429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:54.748923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:54.749542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:54.751455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:54.752149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:54.755165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:54.771590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:54.773405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:54.775246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:54.775246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:54.775246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:54.775246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:54.777877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 256/531] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:54.779620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:54.799940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 276/532] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:54.801777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:54.839724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:54.904553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61da2b8-c1b6-4680-9a1d-53c3e05b0615 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:54.944098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:54.945176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:54.945609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:54.946033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:54.947018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:54.947564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:54.949225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:54.964405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 257/533] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:54.965591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.013226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dee681-3705-47ee-bf77-4e4028b42404 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.064329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:55.079511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.080801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.081918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.082495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.083733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:55.084265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:55.085939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:55.086378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78c5e50-f8f9-4586-88f2-74a203043f46 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.108270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 277/534] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:55.112175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:55.112772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.160069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.161184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.161690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.162194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.164312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=6290142aced542e19cc4b23ab34a3d03) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:55.164478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:55.166324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:55.174809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 258/535] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:54 2022] GET /identity/v3/role_assignments?user.id=6290142aced542e19cc4b23ab34a3d03&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:55.176211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.263061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bbf81-199c-43dd-89ce-65ccbfb53728 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.325901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ad30bd-3963-48a1-9a97-b249d73449dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.327198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad30bd-3963-48a1-9a97-b249d73449dc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.327669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad30bd-3963-48a1-9a97-b249d73449dc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.328134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad30bd-3963-48a1-9a97-b249d73449dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.341247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad30bd-3963-48a1-9a97-b249d73449dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:55.343976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ad30bd-3963-48a1-9a97-b249d73449dc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f3ad30bd-3963-48a1-9a97-b249d73449dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:37:55.364889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:55.365803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:55.366644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:55.368228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f4dd1-87c7-4b17-8134-bb31e42c4a67 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.370068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 278/536] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:55.371394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce538b9-8e2c-45ee-adea-196ce630364d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.371692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce538b9-8e2c-45ee-adea-196ce630364d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.372440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce538b9-8e2c-45ee-adea-196ce630364d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.373522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 279/537] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:55.380516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa79bac-7877-43ac-ac7a-255a1c0db9ca None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.380842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa79bac-7877-43ac-ac7a-255a1c0db9ca None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.381118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa79bac-7877-43ac-ac7a-255a1c0db9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.399787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bfa79bac-7877-43ac-ac7a-255a1c0db9ca None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:55.401020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bfa79bac-7877-43ac-ac7a-255a1c0db9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:55.407956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.408815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.409619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.409941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.420067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:55.421519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:37:55.444353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:55.445303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:55.446145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:55.446561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 259/538] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:55.449219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.453868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:55.480139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:55.485001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 280/539] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:55.486515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41340d1-9011-4321-894a-db9bc45f2941 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.486815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41340d1-9011-4321-894a-db9bc45f2941 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.487103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41340d1-9011-4321-894a-db9bc45f2941 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.492849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 281/540] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:55.492849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41340d1-9011-4321-894a-db9bc45f2941 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.568561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd4b74-1c8f-4aec-b3e2-ec35f22cafa1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.606390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926d5370-b8a4-4fe7-8cf9-82a3bda6fce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.607080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5370-b8a4-4fe7-8cf9-82a3bda6fce0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.607369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5370-b8a4-4fe7-8cf9-82a3bda6fce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.607651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926d5370-b8a4-4fe7-8cf9-82a3bda6fce0 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.608522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d5370-b8a4-4fe7-8cf9-82a3bda6fce0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:55.608816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d5370-b8a4-4fe7-8cf9-82a3bda6fce0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:55.610286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926d5370-b8a4-4fe7-8cf9-82a3bda6fce0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:55.624535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 260/541] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:55.629886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766dc92-5dc1-4833-9b98-9dbd1b9de4e4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.629886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766dc92-5dc1-4833-9b98-9dbd1b9de4e4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.629886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4766dc92-5dc1-4833-9b98-9dbd1b9de4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.646903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-4766dc92-5dc1-4833-9b98-9dbd1b9de4e4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:55.648140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4766dc92-5dc1-4833-9b98-9dbd1b9de4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:55.654727 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41340d1-9011-4321-894a-db9bc45f2941 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.706088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.706088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.706088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.706088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.706490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:55.706490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:55.706490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:55.717103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 282/542] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:55.717949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.736866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 261/543] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:55.737833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766dc92-5dc1-4833-9b98-9dbd1b9de4e4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.776249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:55.779564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:55.850592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef4fad5-15f0-4bec-aec5-ab5f567d36bb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.863572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4766dc92-5dc1-4833-9b98-9dbd1b9de4e4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:55.897378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.898644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.899113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.899516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.914446 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:55.922888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:55.924350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:55.925172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:55.926456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:55.927508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 283/544] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:55.927625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:55.927802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:55.928177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:55.929352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=b35298e764904e9884012cafea48a794) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:55.929814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:55.931567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:55.933201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:55.952568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 262/545] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/role_assignments?user.id=b35298e764904e9884012cafea48a794&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:55.952568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:56.082837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:56.097282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dde413-c04b-40ce-bb36-e550eb658d2d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:56.122583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285fb69-a8a9-4f2c-92cc-6ca70c4989f6 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:56.129280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:56.139423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:56.140628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:56.141096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:56.141548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:56.158245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:56.166699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:56.168509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 263/546] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:56.170105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:56.210806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:56.212257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:56.212919 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:56.214618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:56.216005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=18e34e8f236f4f09a456e10221e2e416) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:56.216687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:56.219145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:56.240615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 284/547] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:55 2022] GET /identity/v3/role_assignments?user.id=18e34e8f236f4f09a456e10221e2e416&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 259 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:56.242616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:56.342703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f37b40-9803-48a6-842d-685cfb3ef28d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:56.420817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:56.421511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:56.421798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:56.422082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:56.422859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:56.424118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:56.429763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:56.453563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 264/548] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:56.476611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:56.504973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:56.528317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe50d5-743d-481b-a5fc-9599863fab19 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:56.617269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:56.617990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:56.618266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:56.618549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:56.619327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:56.619645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:56.621102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:56.631285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 285/549] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:56.636813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:56.701042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d6c03-b410-4641-904b-85fd7d035ceb None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:56.701686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:56.787953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:56.789138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:56.789617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:56.790082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:56.812330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:56.822313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:56.850347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:56.851424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:56.852344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:56.852344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:56.852344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:56.852344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:56.852344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 265/550] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:56.857563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49019715-9fea-45e9-97d8-79224ef2876f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:56.860089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:56.922428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:56.923760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:56.924044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:56.924320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:56.957567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:56.959067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:56.972072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:56.983989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:56.984925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:56.986486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:56.986486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:56.986486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:56.986486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:56.986486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 286/551] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:56.991912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.065667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4175dddb-d358-4c25-bcba-cba6826518ff None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:57.101241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:57.134449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:57.135145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.135441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.135728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.136514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:57.136834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:57.138254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:57.158129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eda5ba-65f1-4ee6-a516-5fc7c537b827 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:57.170948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 266/552] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:57.176778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.233602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:57.234287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.234580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.234867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.236188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:57.236556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:57.238005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:57.270738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 287/553] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:57.278316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.414228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b4571-9e44-47e9-9594-369a97efff49 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:57.414602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7242c2c-d5dd-4c93-a80a-36a7c961d5ff None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:57.456351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a9df07-4e5c-4116-b008-5420743b092d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:57.457197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9df07-4e5c-4116-b008-5420743b092d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.457489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9df07-4e5c-4116-b008-5420743b092d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.457786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a9df07-4e5c-4116-b008-5420743b092d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.461073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:57.463671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:57.469898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9df07-4e5c-4116-b008-5420743b092d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:57.471461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a9df07-4e5c-4116-b008-5420743b092d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:57.484315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:57.485991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.486515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.486935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] PATH_INFO: `/v3/users/nova` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-d7a9df07-4e5c-4116-b008-5420743b092d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:37:57.490503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:57.491749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:57.493124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 288/554] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:37:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:37:57.493705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b87de-174a-4b51-8335-2bfa8c68c39d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.493705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b87de-174a-4b51-8335-2bfa8c68c39d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.494040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b87de-174a-4b51-8335-2bfa8c68c39d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.495573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 289/555] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:57.500702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:57.502050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d50b22-660b-497b-bb4b-768b15db992d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.502542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d50b22-660b-497b-bb4b-768b15db992d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.502833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d50b22-660b-497b-bb4b-768b15db992d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.503110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:57.521214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-c8d50b22-660b-497b-bb4b-768b15db992d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:57.522460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c8d50b22-660b-497b-bb4b-768b15db992d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:37:57.530195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:57.532355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:37:57.535110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:57.538981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 267/556] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:37:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:57.540317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.595211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 290/557] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:57.596090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d50b22-660b-497b-bb4b-768b15db992d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.672448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16144785-e7f6-4a27-834c-22f62ccff1af None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:57.716416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:57.717351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.717910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.718326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.719418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:57.720444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:57.722108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:57.722461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d50b22-660b-497b-bb4b-768b15db992d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:57.743860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 268/558] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 30 12:37:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:57.745274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.765937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:57.779339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:57.780355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.780790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.781176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.782855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:57.783326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:57.785326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:57.799988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:57.815759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 291/559] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:37:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:57.817339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.874539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830510f-8a44-4e92-a94a-926712c8829c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:57.915315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:57.916466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:57.916466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:57.916728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:57.928313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:57.936278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:57.937450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:57.938282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:57.944300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 269/560] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:57.945384 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:57.953304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f92428-df67-4923-b19c-eb92b283b719 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.008862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.009961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.010633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.011282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.053400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.058494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabade79-c5b4-439b-984e-f0bb593ab028 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.082840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.097864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.098813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.099217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.099594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.104101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.105766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.112372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.114013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:58.133244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:58.134387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:58.135890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:58.135890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:58.135890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:58.135890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:58.142969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 270/561] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:58.142969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.234300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 292/562] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:37:58.236872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.249478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656f0f3-001a-459d-817a-8dd294418c69 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.285903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.286970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.287163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.287575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.288628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:58.289034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.290515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.304626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 271/563] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:58.305800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.322809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.347397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.369601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6b3975-8238-42fc-a96f-00c7fd951926 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.417347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df1fcf-c3a8-44bb-bd9b-98e54c36d0b6 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.419176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.420149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.420602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.421014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.421884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:58.422344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.424634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.442911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 293/564] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:58.444160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.455844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.456846 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.457232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.457612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.469306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.471857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:58.490143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:58.491216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:58.492265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:58.492265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:58.492265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:58.492265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:58.503094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 272/565] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:58.503094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.570173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbc7902-208d-49c5-83ee-fd4ea476d22f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.572036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.613388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.614495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.614824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a92908c-59c4-459d-80d5-a21f78fb61fb None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.615103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.615532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.629107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.630929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.634121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.652645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:37:58.653617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:58.654672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:58.655769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:37:58.655769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:37:58.655769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:37:58.655769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:58.656039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.656206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.656660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.658784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 294/566] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:58.659775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.673846 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.675459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:37:58.693248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:58.694514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:58.695601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:58.699912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 273/567] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:58.703140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.797194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8a5e3-8520-4212-99ff-92642a728270 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.818865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba76938-4a94-4f61-b2be-7c26df67455d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:58.838145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.839122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.839527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.840185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.841067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:58.841486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.843441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.846452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.857568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 295/568] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:58.858625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.859451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baddb1d7-fedb-44b8-8b41-d8d0c58c82b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:58.860241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddb1d7-fedb-44b8-8b41-d8d0c58c82b9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.861042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddb1d7-fedb-44b8-8b41-d8d0c58c82b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.861042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baddb1d7-fedb-44b8-8b41-d8d0c58c82b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.861798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddb1d7-fedb-44b8-8b41-d8d0c58c82b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:58.862121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddb1d7-fedb-44b8-8b41-d8d0c58c82b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:58.863518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baddb1d7-fedb-44b8-8b41-d8d0c58c82b9 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:58.875261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 274/569] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:58.877244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dd40-08c9-497f-a13b-d3bd1bbe8299 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.877539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dd40-08c9-497f-a13b-d3bd1bbe8299 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.877823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6dd40-08c9-497f-a13b-d3bd1bbe8299 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.879376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 275/570] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:58.880348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b1004-dafc-42c2-8711-5a85b02c4670 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:58.880669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b1004-dafc-42c2-8711-5a85b02c4670 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:58.880938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990b1004-dafc-42c2-8711-5a85b02c4670 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:58.882331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 276/571] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:37:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:37:58.884403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b1004-dafc-42c2-8711-5a85b02c4670 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:58.926134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:58.974866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8fb8cf-31f9-40b2-92b5-af064bb78348 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.014091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.014788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.015079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.015186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990b1004-dafc-42c2-8711-5a85b02c4670 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.015363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.016151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:59.016496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:59.018567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:59.031147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 296/572] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:59.032665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.061017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce47f63-c238-460c-a142-f5bdbd34b4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.062218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47f63-c238-460c-a142-f5bdbd34b4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.062735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47f63-c238-460c-a142-f5bdbd34b4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.063239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce47f63-c238-460c-a142-f5bdbd34b4a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.075473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47f63-c238-460c-a142-f5bdbd34b4a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:59.077023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce47f63-c238-460c-a142-f5bdbd34b4a5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-bce47f63-c238-460c-a142-f5bdbd34b4a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:37:59.100105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:59.101189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:59.102056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 277/573] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:37:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:59.102680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607173af-0c46-4170-a0d6-370fe0df63cc None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.102964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607173af-0c46-4170-a0d6-370fe0df63cc None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.103252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607173af-0c46-4170-a0d6-370fe0df63cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.130680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-607173af-0c46-4170-a0d6-370fe0df63cc None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:59.137144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-607173af-0c46-4170-a0d6-370fe0df63cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:59.152304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702ccddd-137d-4cd9-ad3d-987efe061531 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.168525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:59.179525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:59.188413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.189897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.190182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.190464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.198452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:59.199904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:59.208168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 278/574] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:59.209575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacabc9-bea3-44aa-8514-62e13d21d9cc None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.209871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacabc9-bea3-44aa-8514-62e13d21d9cc None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.210151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacabc9-bea3-44aa-8514-62e13d21d9cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:37:59.214344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:59.215273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:37:59.216215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:59.219522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 297/575] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:59.220639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.230792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5aacabc9-bea3-44aa-8514-62e13d21d9cc None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:37:59.230792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5aacabc9-bea3-44aa-8514-62e13d21d9cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:37:59.301582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 279/576] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:37:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:37:59.302452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacabc9-bea3-44aa-8514-62e13d21d9cc None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.336787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d840a7-dcfb-483d-9888-0c63078770d0 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.378806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.379688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.379974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.380253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/5f39f1ea697c4426b30a5e6fa795e4e4/roles/9637b53466484a69b2e09ccf4a649721` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.396180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=5f39f1ea697c4426b30a5e6fa795e4e4, role_id=9637b53466484a69b2e09ccf4a649721)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:59.397658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:59.411206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 298/577] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:37:59 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/5f39f1ea697c4426b30a5e6fa795e4e4/roles/9637b53466484a69b2e09ccf4a649721 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:37:59.412048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.412632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacabc9-bea3-44aa-8514-62e13d21d9cc None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.421511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:59.455229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:59.467729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.468460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.468755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.469037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.469908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:59.470397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:59.472133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:59.485922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 280/578] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:59.487023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.559744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c2ba7-3462-4be7-ab57-7b9013ee8d6c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.604442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.605365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.605652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.606438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.607871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:59.608672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:59.611886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:59.612200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d5c68-7a3d-43bb-a897-181aa34deb41 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.635377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 299/579] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:59.640446 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.653115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.654288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.654587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.654867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] PATH_INFO: `/v3/roles/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.670963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:59.679514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:59.680564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 281/580] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:59.681434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.716938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:59.754509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:59.773403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01c5238-6eed-4bb8-a5e6-f4e73948a532 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.812793 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68b8b04-e9f6-4005-804b-922b999d38ed None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.816291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.817144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.817427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.817714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.829701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:37:59.837690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:37:59.838783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:37:59.839624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 300/581] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:37:59.840807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.857556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:37:59.858133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:37:59.858420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:37:59.858703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:37:59.859548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=addf74dd6b6f4f78bace4808bf676acc) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:37:59.859865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:37:59.861999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:37:59.868109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 282/582] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/role_assignments?user.id=addf74dd6b6f4f78bace4808bf676acc&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:37:59.868976 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:37:59.978200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:37:59.994854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb21283-27a8-4f7b-ab21-07afc1a4a1f9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:37:59.998725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af178e2-5465-4e29-80dc-8ccaed20dadd None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.039377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.040360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.040849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.041297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.042061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:00.042384 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.043908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.047412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.048696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.049190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.049656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.056768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 283/583] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:00.057690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.066344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.068094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.072735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:00.097781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:00.098804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:00.099708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:00.099708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:00.099708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:00.099708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:00.106999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 301/584] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:00.106999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.183797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06486bbd-6bbf-4c49-b2a3-79bf194a32a1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.219041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.220233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.220577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.220862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.221655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:00.221925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.223312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.232896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 284/585] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:00.233752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.254481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752396bb-65a9-4e9a-bbfe-d02b29674c56 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.272901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:00.302636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.303544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.303902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.304257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.319865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.321387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:00.340015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:00.341403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:00.342289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:00.342289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:00.342289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:00.342289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:00.342289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 302/586] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:00.342584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.353049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5801ba8-7bca-4480-aab4-5cd4dc1315b0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.395857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.396526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.396821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.397108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.397845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:00.398161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.399560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.405750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:00.417666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 285/587] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:00.417666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.489819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a94634c-bb5d-4247-a512-cc88147d57cb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.529243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:00.543512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120d19a1-c013-4b9c-965b-8e0239cdb0b1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.549164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.550263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.550748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.551251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.576002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.577934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.592927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.593932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.594419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.595477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.596725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:00.597218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.598787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:00.599519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:00.600373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:00.601291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:00.601291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:00.601291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:00.601291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:00.601291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 303/588] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:00.602356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.617978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 286/589] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:00.619239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.724841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86083bdd-eaa7-4619-9fae-e632bde58241 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.728692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:00.756005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b74074-3545-46d3-8895-61a087c7a562 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.773804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.774976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.775714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.776066 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.786087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.788326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.790314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:00.797171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.798077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.798820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.798820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.799783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:00.800442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:00.803307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:00.815478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:00.817367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:00.818819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:00.824396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 304/590] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:00.825835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.830725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 287/591] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:00.831882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:00.953682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb772b01-65dc-4070-b41a-bcceea8815a3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.958496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c18b6-857a-43b5-b098-57de68441018 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:00.995757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:00.996698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:00.997063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:00.997438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:00.999894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.002131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.002699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.003154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.004146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:01.004668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.006253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.006907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.007787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.022706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 288/592] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:01.023805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:01.028598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:01.029560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:01.030496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 305/593] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:00 2022] GET /identity/v3/users/glance => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:01.031100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.060794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:01.089147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:01.152839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3365ad-40ea-4f49-9e75-37bd5971226d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:01.173443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ad195-3256-48ab-960e-7e0bc2ac0b05 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:01.199634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.201045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.202001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.202458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.215181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.217244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.217592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.218590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.218977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.219359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/6290142aced542e19cc4b23ab34a3d03/roles/9637b53466484a69b2e09ccf4a649721` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.237242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=6290142aced542e19cc4b23ab34a3d03, role_id=9637b53466484a69b2e09ccf4a649721)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.239586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:01.240292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:01.242343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 12:38:01.244512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:01.249859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 289/594] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:01.252293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.272598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 306/595] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:01 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/6290142aced542e19cc4b23ab34a3d03/roles/9637b53466484a69b2e09ccf4a649721 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:38:01.273641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.407503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:01.456237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437de4b-0180-40ac-a71f-c5a61ece7413 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:01.495755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c3e10-4ca3-47c4-803b-17571b050634 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:01.503148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.503864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.504157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.504470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.505376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:01.506897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.508458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.531516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:01.537572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 307/596] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:01.544239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.571522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.572703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.574383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.574831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.575836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:01.577318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.579297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.606716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 290/597] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:01.612625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.678417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d981762-cda0-4101-b2c0-385073374a85 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:01.707777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:01.717324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850e8ce-2c77-4ee7-afd0-1c5d320001ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.718135 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e8ce-2c77-4ee7-afd0-1c5d320001ce None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.718417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e8ce-2c77-4ee7-afd0-1c5d320001ce None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.718691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850e8ce-2c77-4ee7-afd0-1c5d320001ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.727131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99718f98-4f80-4de1-8e92-1ec9ab7a8fed None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:01.730589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e8ce-2c77-4ee7-afd0-1c5d320001ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.732051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850e8ce-2c77-4ee7-afd0-1c5d320001ce None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-c850e8ce-2c77-4ee7-afd0-1c5d320001ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:01.751667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:01.753230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:01.754188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:01.754188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:01.754188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:01.754188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:01.754188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 308/598] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:01.755961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804be6-8d34-48a2-9f67-1851075b07e3 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.755961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804be6-8d34-48a2-9f67-1851075b07e3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.755961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26804be6-8d34-48a2-9f67-1851075b07e3 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.757220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 309/599] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:01.761304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804be6-8d34-48a2-9f67-1851075b07e3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.772807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e6975-32ae-4a6f-838e-03d87ec37566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.774063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6975-32ae-4a6f-838e-03d87ec37566 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.774687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6975-32ae-4a6f-838e-03d87ec37566 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.775064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e6975-32ae-4a6f-838e-03d87ec37566 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.787069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6975-32ae-4a6f-838e-03d87ec37566 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.788515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e6975-32ae-4a6f-838e-03d87ec37566 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-7c5e6975-32ae-4a6f-838e-03d87ec37566 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:01.809084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:01.810045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:01.810939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:01.810939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:01.810939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:01.810939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:01.810939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 291/600] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:01.812092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996b2d-2487-4295-9418-45453587fe73 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.812412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996b2d-2487-4295-9418-45453587fe73 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.812770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3996b2d-2487-4295-9418-45453587fe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.830152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b3996b2d-2487-4295-9418-45453587fe73 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:01.831397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b3996b2d-2487-4295-9418-45453587fe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:01.850788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:01.914453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26804be6-8d34-48a2-9f67-1851075b07e3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:01.916500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 292/601] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:01.917542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996b2d-2487-4295-9418-45453587fe73 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:01.962229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:01.963619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:01.964463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:01.965478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:01.966729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:01.967582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:01.969731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:01.990560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 310/602] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:01.991570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.046331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:02.063677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3996b2d-2487-4295-9418-45453587fe73 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.109429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.110778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.111225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.111510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.112263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:02.112628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.114073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.128835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 293/603] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:02.130625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.145497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17701380-6f34-417a-a69b-d5b0abc02b22 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.154917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:02.187875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.189001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.189365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.189798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.201525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:02.212010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:02.213054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:02.213897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:02.218230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 311/604] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:02.219176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.259860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0ef7e8-14f0-4de1-97f8-64ce657e8edf None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.299654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.300393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.300701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.300982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.309064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.310605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.325624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:02.328426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:02.329647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:02.330684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:02.331199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ac8a0-86de-401f-bad9-e4a246272a2b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.332924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 294/605] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:02.333903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.372203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c691351-a073-41f8-89bb-94954166c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.372642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c691351-a073-41f8-89bb-94954166c01e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.372920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c691351-a073-41f8-89bb-94954166c01e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.373205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c691351-a073-41f8-89bb-94954166c01e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.380987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c691351-a073-41f8-89bb-94954166c01e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.382457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c691351-a073-41f8-89bb-94954166c01e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-0c691351-a073-41f8-89bb-94954166c01e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:02.398528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:02.399634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:02.400739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:02.404440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 312/606] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:02.406045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d86c-5e94-4983-805b-2d640a9758e5 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.406165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d86c-5e94-4983-805b-2d640a9758e5 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.406414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204d86c-5e94-4983-805b-2d640a9758e5 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.408264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 313/607] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:02.409413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204d86c-5e94-4983-805b-2d640a9758e5 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.416858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:02.449889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb0a1ad-bfa0-4454-a2d2-b1cb0968c179 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.498833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.499122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.499512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.500161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:02.500508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.503137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.512014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 295/608] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:02.512927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.547050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204d86c-5e94-4983-805b-2d640a9758e5 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.587839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c68ca-77a6-4611-8acd-9aa585e855db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.588960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c68ca-77a6-4611-8acd-9aa585e855db None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.589626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c68ca-77a6-4611-8acd-9aa585e855db None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.590237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c68ca-77a6-4611-8acd-9aa585e855db None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.591065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c68ca-77a6-4611-8acd-9aa585e855db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:02.591388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c68ca-77a6-4611-8acd-9aa585e855db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.592875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c68ca-77a6-4611-8acd-9aa585e855db None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.611476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 314/609] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:02.611476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe9045-a326-4392-9ec3-8d58d9e0e910 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.611476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe9045-a326-4392-9ec3-8d58d9e0e910 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.611476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fe9045-a326-4392-9ec3-8d58d9e0e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.626533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1f9ef-1501-432a-8c9f-3838f429b575 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.627749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-71fe9045-a326-4392-9ec3-8d58d9e0e910 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:02.629289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-71fe9045-a326-4392-9ec3-8d58d9e0e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:02.647616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:02.670427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.671066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.671420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.671645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.672474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:02.673333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.675309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.677461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:02.696788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 296/610] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:02.696788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.719360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 315/611] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:02.721386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe9045-a326-4392-9ec3-8d58d9e0e910 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.825849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99970877-aea1-4013-80aa-dfbbc4e0e11c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.836790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fe9045-a326-4392-9ec3-8d58d9e0e910 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:02.862404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.863131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.863420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.863703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.875134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.877072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:02.877961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.878072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:02.878257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:02.878530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/b35298e764904e9884012cafea48a794/roles/9637b53466484a69b2e09ccf4a649721` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:02.896861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=b35298e764904e9884012cafea48a794, role_id=9637b53466484a69b2e09ccf4a649721)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:02.897532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:02.898397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:02.899314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:02.899314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:02.899314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:02.899314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:02.899546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:02.903929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 297/612] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:02.905183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:02.913214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:02.918262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 316/613] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:02 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/b35298e764904e9884012cafea48a794/roles/9637b53466484a69b2e09ccf4a649721 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:38:02.921273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.013693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:03.090056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd2d40-cbe3-42b8-9176-d30d8fef01f4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:03.092290 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069171d3-282b-4ae0-87af-17f5df037fb2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:03.140232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:03.140460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:03.141092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.141216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.141372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.142128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.142500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/18e34e8f236f4f09a456e10221e2e416/roles/9637b53466484a69b2e09ccf4a649721` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.143390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.162054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:03.162462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=18e34e8f236f4f09a456e10221e2e416, role_id=9637b53466484a69b2e09ccf4a649721)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:03.164030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:03.171435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:03.172430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:03.174245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 317/614] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:03.175515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.185048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 298/615] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:02 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/18e34e8f236f4f09a456e10221e2e416/roles/9637b53466484a69b2e09ccf4a649721 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:38:03.186025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.253051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:03.328939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6d57d-5207-4cd4-8324-2da97cffe688 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:03.343612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:03.358298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960e813-013d-4a43-9472-81e072205a88 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:03.396548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:03.397537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.398011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.398582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.399614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:03.400174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:03.401981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:03.411486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:03.413494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.413865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.414236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.415072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:03.415449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:03.417713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:03.420115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 318/616] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:03.427346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.432104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 299/617] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:03.435258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.587817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eb8e85-e1c1-4dbb-ba70-a63a8bf3891e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:03.600405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b291387-a27c-4ae5-961d-0fae1ddcff8b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:03.625621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:03.651021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36f8f8a-ee83-429d-978a-6519d9799640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:03.651742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8f8a-ee83-429d-978a-6519d9799640 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.652024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8f8a-ee83-429d-978a-6519d9799640 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.652299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36f8f8a-ee83-429d-978a-6519d9799640 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.667724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f8f8a-ee83-429d-978a-6519d9799640 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:03.667936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ddb64-616a-45d7-8ca6-39bb9b3c4393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:03.667936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ddb64-616a-45d7-8ca6-39bb9b3c4393 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.667936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ddb64-616a-45d7-8ca6-39bb9b3c4393 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.668312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ddb64-616a-45d7-8ca6-39bb9b3c4393 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.669896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36f8f8a-ee83-429d-978a-6519d9799640 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:03.687908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ddb64-616a-45d7-8ca6-39bb9b3c4393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:03.689722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977ddb64-616a-45d7-8ca6-39bb9b3c4393 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-d36f8f8a-ee83-429d-978a-6519d9799640 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:03.695476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:03.696444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 319/618] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:38:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745305a-dfde-4d31-bf0e-014c9b5897fb None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.697462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745305a-dfde-4d31-bf0e-014c9b5897fb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.698161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745305a-dfde-4d31-bf0e-014c9b5897fb None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.699136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 320/619] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:03.705582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745305a-dfde-4d31-bf0e-014c9b5897fb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-977ddb64-616a-45d7-8ca6-39bb9b3c4393 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:03.713401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:03.714454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:03.715342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:03.715342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:03.715342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:03.715342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:03.715342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 300/620] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:03.717774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422a7e4-27ed-458a-945c-b626112030d4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.717774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422a7e4-27ed-458a-945c-b626112030d4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.717774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3422a7e4-27ed-458a-945c-b626112030d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.741513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3422a7e4-27ed-458a-945c-b626112030d4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:03.743478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3422a7e4-27ed-458a-945c-b626112030d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:03.747401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:03.836472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 301/621] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:03.836472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422a7e4-27ed-458a-945c-b626112030d4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.886542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745305a-dfde-4d31-bf0e-014c9b5897fb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:03.927282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:03.928185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:03.928670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:03.929130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:03.930233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:03.930786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:03.932517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:03.957150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 321/622] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:38:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:03.957150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:03.965330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3422a7e4-27ed-458a-945c-b626112030d4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.003152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.008734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.009422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.009712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.009994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.011186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:04.011507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.013267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.025490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.035315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 302/623] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:04.035315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.087768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716ac24a-48c9-4376-b96f-11c9b24bcaf9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.137005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.137819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.138593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.138892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.154414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:04.159612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f4a2b1-32dd-45cd-92ab-8ec38f8a4a15 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:04.164475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:04.165412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:04.166301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 322/624] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:04.167022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.211002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.211992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.212528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.213142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.303221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.306516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84d716-a0ad-4efa-88b3-d51a45dbdc23 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.307610 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.308762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.310381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.355637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.356500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.356795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.357081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.366888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.368725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:04.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:04.384898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:04.386396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:04.389669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 323/625] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:04.390720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.444524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 303/626] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:04.446215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.506372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37bf7e9-51de-4724-9647-6fb633d768fc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.542036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.542725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.543015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.543282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.544038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:04.544352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.545795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.559189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 324/627] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:04.559189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.567805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.572555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58caa4c7-f888-4cf2-a2c8-06a7c2d1f060 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.580019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.613294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.613986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.614278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.614562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.615496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:04.615739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.617361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.641906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 304/628] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:04.643160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.682614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0616803-44c6-4c7b-bdc9-9b1b90833dcc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.721549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.722803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.723383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.723850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.736341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.738335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.755899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7e9efb-cabc-4bd7-bdce-745fff528cef None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:04.764193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:04.765151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:04.766026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:04.766026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:04.766026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:04.766026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:04.773687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 325/629] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:04.774983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.794061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.795215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.795215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.795503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.807841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.809361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:04.828589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:04.829709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:04.830797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:04.830797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:04.830797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:04.830797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:04.834513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 305/630] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:04.835530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.849688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.864036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:04.901747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996aa316-073b-4e01-b6cf-ecc7cfa22c38 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.941475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.942699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.943337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.943903 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.949917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e27089-e4a0-4007-9f74-7880af279e53 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:04.956573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.958600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:04.978255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:04.979229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:04.980147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:04.980147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:04.980147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:04.980147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:04.982467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 326/631] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:04.983550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:04.991939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:04.992655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:04.992950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:04.993236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:04.994047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:04.994364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:04.996085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.015738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 306/632] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:05.015738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.087074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.108778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455113d-f321-4826-8020-f3c9f002ff31 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.119930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8703a8-5b4b-4dba-945a-71001d7e1f52 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.136961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.154151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.154852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.155137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.155417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.156462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:05.156824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.158598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.174762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.175585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 327/633] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:05.176046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.176562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.176780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.177261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.178231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:05.178754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.182044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.197661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 307/634] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:05.202361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.306135 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f293e8-97e5-409b-9c70-17fc43059a7b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.315718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed9892-8be1-41d3-810e-53ca25af68a8 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.343878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.345237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.345679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.345963 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.346439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.353165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.354657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.356107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c9b51-36aa-4ba6-97ab-a744eb4a1a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.356936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9b51-36aa-4ba6-97ab-a744eb4a1a79 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.357223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9b51-36aa-4ba6-97ab-a744eb4a1a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.357497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c9b51-36aa-4ba6-97ab-a744eb4a1a79 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.366697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c9b51-36aa-4ba6-97ab-a744eb4a1a79 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.368141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c9b51-36aa-4ba6-97ab-a744eb4a1a79 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:05.369915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:05.370988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:05.371900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 328/635] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:05.372423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-9d2c9b51-36aa-4ba6-97ab-a744eb4a1a79 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:05.389373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:05.390390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:38:05.391449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:05.395528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 308/636] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:05.396948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5332-cea9-46cf-bb3e-203ff15c7866 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.397261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5332-cea9-46cf-bb3e-203ff15c7866 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.397517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4d5332-cea9-46cf-bb3e-203ff15c7866 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.400432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 309/637] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:05.400432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5332-cea9-46cf-bb3e-203ff15c7866 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.430072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.486070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dba6178-428a-4665-a5c6-5b995b379c71 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.506944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4d5332-cea9-46cf-bb3e-203ff15c7866 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.521300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.522135 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.522424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.522891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.529748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.531215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.541836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823b42f8-a492-4e4f-84db-98ecf4b1a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.542504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b42f8-a492-4e4f-84db-98ecf4b1a7ae None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.542787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b42f8-a492-4e4f-84db-98ecf4b1a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.543061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823b42f8-a492-4e4f-84db-98ecf4b1a7ae None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.543846 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b42f8-a492-4e4f-84db-98ecf4b1a7ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:05.544156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b42f8-a492-4e4f-84db-98ecf4b1a7ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.545604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823b42f8-a492-4e4f-84db-98ecf4b1a7ae None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:05.545988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:05.547019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 329/638] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:05.548654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.563181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 310/639] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:05.564572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4693f2-372a-4a16-85e1-820ab1df460d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.564864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4693f2-372a-4a16-85e1-820ab1df460d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.565144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4693f2-372a-4a16-85e1-820ab1df460d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.581069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0a4693f2-372a-4a16-85e1-820ab1df460d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:05.582279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0a4693f2-372a-4a16-85e1-820ab1df460d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:05.634608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.655903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 311/640] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:05.657341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d0e47-1235-4cb8-b886-54d95e13e180 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.657661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11e8a06-9835-4343-8b5f-aa2dee9d0fbd None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.657891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d0e47-1235-4cb8-b886-54d95e13e180 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.658143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367d0e47-1235-4cb8-b886-54d95e13e180 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.660445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 312/641] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:05.660445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d0e47-1235-4cb8-b886-54d95e13e180 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.661040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.701460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.702144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.702426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.702702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.703541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:05.704372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.706250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.724775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 330/642] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:05.725624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.783800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367d0e47-1235-4cb8-b886-54d95e13e180 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.821120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbd79a-63bf-4a1a-a25e-1519d4371c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.821706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbd79a-63bf-4a1a-a25e-1519d4371c29 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.822053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbd79a-63bf-4a1a-a25e-1519d4371c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.822277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbd79a-63bf-4a1a-a25e-1519d4371c29 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.823068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbd79a-63bf-4a1a-a25e-1519d4371c29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:05.823472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbd79a-63bf-4a1a-a25e-1519d4371c29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.824847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbd79a-63bf-4a1a-a25e-1519d4371c29 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.830445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d0fab-d162-484b-a9db-54b5072e0856 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:05.837871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 313/643] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:05.839217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc702-5cf5-4259-9b5f-4f08c75dcb20 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.839513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc702-5cf5-4259-9b5f-4f08c75dcb20 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.839798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fccc702-5cf5-4259-9b5f-4f08c75dcb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.856841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6fccc702-5cf5-4259-9b5f-4f08c75dcb20 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:05.858046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6fccc702-5cf5-4259-9b5f-4f08c75dcb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:05.868358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:05.869041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:05.869333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:05.869612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:05.870442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=5f39f1ea697c4426b30a5e6fa795e4e4) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:05.870757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:05.872190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:05.879174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 331/644] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/role_assignments?user.id=5f39f1ea697c4426b30a5e6fa795e4e4&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:05.879974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:05.895050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.912595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:05.952416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 314/645] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:05.952416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccc702-5cf5-4259-9b5f-4f08c75dcb20 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.018359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee6d257-b410-4a17-80d6-7d63f64d6c04 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.058105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.058913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.059201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.059477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.071219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fccc702-5cf5-4259-9b5f-4f08c75dcb20 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.073216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:06.083650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:06.084926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:06.085872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 332/646] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:06.086584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.115724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.116448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.116901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.117186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.161828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:06.187084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:06.194053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:06.195534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:06.206763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3c93b0-106c-4625-9eb8-009dd79a6e48 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.250196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.252314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.252645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.252942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/addf74dd6b6f4f78bace4808bf676acc/roles/9637b53466484a69b2e09ccf4a649721` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.272176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=addf74dd6b6f4f78bace4808bf676acc, role_id=9637b53466484a69b2e09ccf4a649721)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:06.274002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:06.287585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 333/647] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:06 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/addf74dd6b6f4f78bace4808bf676acc/roles/9637b53466484a69b2e09ccf4a649721 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:38:06.288778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.338871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 315/648] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:06.339697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.433466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8689e9-a0b4-4d1b-9572-09e4c60fc58c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.441814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:06.483121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef989d-ddde-4de3-abcf-995a0e9265b0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.485722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.487418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.487707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.487987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.492853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:06.504377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:06.512750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:06.513728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 334/649] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:06.515656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.545767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.546450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.546742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.547027 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.548634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:06.549174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:06.550580 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:06.563924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 316/650] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:06.563924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.659731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1321eb4e-7fbc-4326-bc32-6bf0f6c9f129 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.703646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.704663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.705015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.705392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.710509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497407b-05d0-431e-b4c0-75cfb4748c8e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.718886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:06.721113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:06.743625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:06.744635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:06.745526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:06.745526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:06.745526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:06.745526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:06.748462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 335/651] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:06.749675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.754532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:06.762589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.763975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.764569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.765106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.766859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:06.767882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:06.770127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:06.782837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 317/652] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:06.783682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.818183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:06.874229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee84f-f7d3-48e5-9618-cd0d2122f581 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.909133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01453d00-f101-45a1-8a8e-49c2e8a9ce67 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:06.909603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.910456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.910688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.910969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.922384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:06.924432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:06.942054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:06.942981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:06.943978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:06.943978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:06.943978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:06.943978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:06.947674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 336/653] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:06.948707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:06.953891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:06.954823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:06.955330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:06.955807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:06.956781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:06.957298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:06.959042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:06.976345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 318/654] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:06.977761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.041382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.051096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.054368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0eb11aa-e167-4184-affd-068df831c359 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.092780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.093581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.093866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.094141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.096643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a89cf2-136f-4d7d-8a2d-990e76141af9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.106703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.108323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:07.129287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:07.130295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:07.131798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:07.131798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:07.131798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:07.131798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:07.131798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 337/655] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:07.131798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.141084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.142701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.143218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.143813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.144815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:07.145459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.147060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.160686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 319/656] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:07.161882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.249852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77bc6a6-f57e-43de-9eba-cd9b267d3a55 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.277699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d305d4-4939-4a25-92fd-5ff41f58381e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.287263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.288066 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.288349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.288654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.295142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.298071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.300358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:07.317054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:07.318001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:07.318900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:07.319881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 338/657] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:07.320971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.322207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.323123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.323948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.324457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.325532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:07.326066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.327796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.342008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.343282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 320/658] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:07.345079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.435955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e7912d-9388-4c9e-baf9-a479346d9214 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.457297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a7b60-5966-4e1c-921e-bae85e873cbd None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.473241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.474051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.474334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.474606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.482934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.484586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.501794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:07.502005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:07.502910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 30 12:38:07.503848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:07.505830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.506338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.506817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.507929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 339/659] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:07.508396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:07.508813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.509243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.510916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.525342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 321/660] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:07.526727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.566288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.589268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.622359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc26099-1e32-4e4b-84f8-110111c045e6 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.644758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffd3886-a7d0-48e1-a2ad-58755b832e79 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.661220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.662024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.662311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.662591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] PATH_INFO: `/v3/users/glance` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.670816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.672377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.687389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:07.688082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:07.689840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 340/661] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:07.691468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.692784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.693227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.693663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.694688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:07.695166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.697234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.718117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 322/662] 10.222.0.20 () {56 vars in 1139 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:07.719268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.807613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50df35f6-9186-4fcf-820b-3485ab91d9bc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.826901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.837579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc0f5e8-e1c1-4b82-8d65-4778e1b57719 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:07.842735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:07.850886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.851581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.851959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.852337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.853302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=6290142aced542e19cc4b23ab34a3d03) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:07.853716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.855463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.863293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 341/663] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/role_assignments?user.id=6290142aced542e19cc4b23ab34a3d03&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:07.864331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:07.886308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:07.887327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:07.887811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:07.888271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:07.889346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:07.889913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:07.892672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:07.915057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 323/664] 10.222.0.20 () {56 vars in 1137 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:07.922299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:08.052068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455fc8b-471d-48ed-8d44-90ed06427b09 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:08.090527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad849713-5dd6-4502-a2db-14f10d343d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:08.091184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad849713-5dd6-4502-a2db-14f10d343d56 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.091469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad849713-5dd6-4502-a2db-14f10d343d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.091748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad849713-5dd6-4502-a2db-14f10d343d56 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.119278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c685e266-3fdb-4825-81a2-87f52d752486 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:08.162840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbcdfcd-039e-446e-b240-9484ade87955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:08.163632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdfcd-039e-446e-b240-9484ade87955 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.163919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdfcd-039e-446e-b240-9484ade87955 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.164204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcdfcd-039e-446e-b240-9484ade87955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.165436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:08.175865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad849713-5dd6-4502-a2db-14f10d343d56 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:08.177905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad849713-5dd6-4502-a2db-14f10d343d56 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:08.191611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:08.271652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcdfcd-039e-446e-b240-9484ade87955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:08.273207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbcdfcd-039e-446e-b240-9484ade87955 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:08.334460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 342/665] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:08.335933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae5c53-6ffa-40b6-9442-bf2e125fc20f None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.336224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae5c53-6ffa-40b6-9442-bf2e125fc20f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.336534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae5c53-6ffa-40b6-9442-bf2e125fc20f None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.338262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 343/666] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:08.339272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae5c53-6ffa-40b6-9442-bf2e125fc20f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:08.412801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 324/667] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:08.414566 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d064d-e48b-457a-93fb-8cec3b83d782 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.415074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d064d-e48b-457a-93fb-8cec3b83d782 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.415526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3d064d-e48b-457a-93fb-8cec3b83d782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.439295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5d3d064d-e48b-457a-93fb-8cec3b83d782 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:08.440708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5d3d064d-e48b-457a-93fb-8cec3b83d782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:08.450410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:08.459923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae5c53-6ffa-40b6-9442-bf2e125fc20f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:08.500416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:08.501884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.502257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.502625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.511037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:08.514804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:08.517572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:08.538428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:08.539567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:08.540596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:08.540596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:08.540596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:08.540596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:08.540596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 344/668] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:08.540596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:08.542966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 325/669] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:08.545955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f20a6-94ed-44a8-893b-35a9656da561 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.546255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f20a6-94ed-44a8-893b-35a9656da561 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.546542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29f20a6-94ed-44a8-893b-35a9656da561 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.548039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 326/670] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:08.548707 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f20a6-94ed-44a8-893b-35a9656da561 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:08.661288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8c629-992c-4545-961e-a352b62936de None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:08.663408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29f20a6-94ed-44a8-893b-35a9656da561 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:08.703847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:08.704823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.705140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.705424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.706956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301968e0-44fe-44d5-9437-702483e0932b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:08.707634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301968e0-44fe-44d5-9437-702483e0932b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.707926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301968e0-44fe-44d5-9437-702483e0932b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.708213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301968e0-44fe-44d5-9437-702483e0932b None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.708987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301968e0-44fe-44d5-9437-702483e0932b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:08.709304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301968e0-44fe-44d5-9437-702483e0932b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:08.710703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301968e0-44fe-44d5-9437-702483e0932b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:08.718520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:08.721049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:08.723825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 327/671] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:08.724668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f0be-ae63-450d-a30d-c4efe96b107e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.724956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f0be-ae63-450d-a30d-c4efe96b107e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.725243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2999f0be-ae63-450d-a30d-c4efe96b107e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.733956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:08.742894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2999f0be-ae63-450d-a30d-c4efe96b107e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:08.744105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2999f0be-ae63-450d-a30d-c4efe96b107e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:08.745401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:08.746476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:08.747571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:08.747571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:08.747571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:08.747571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:08.754264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 345/672] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:08.755221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:08.788279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:08.824083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 328/673] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:08.833625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f0be-ae63-450d-a30d-c4efe96b107e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:08.869717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03092ebd-ffae-4b74-a1f0-7ee6ae6770d4 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:08.915356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:08.916087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.916370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.916676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:08.933561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:08.942535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:08.943646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:08.944526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 346/674] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:08.945984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:08.958201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2999f0be-ae63-450d-a30d-c4efe96b107e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:08.997358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:08.998349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:08.998819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:08.999000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.008768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.010239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.012310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:09.027825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:09.028990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:09.029904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:09.032752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 329/675] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:09.034364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.060994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ede2e-2414-4cf0-b705-b703c68ff8c9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.068513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.098686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.099270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.099562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.099842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.100594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:09.100909 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.102280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.115994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 347/676] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:09.116820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.150008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a858369b-8aea-4af9-9e2f-56f809588e77 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.186919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.187636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.187923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.188748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.199518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:09.207549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:09.208605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:09.209459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 330/677] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:09.210162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.232833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7421fbae-9083-4cb6-b55a-06ab2fd1e52a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.257636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.275881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.276588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.276880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.277163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.277916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:09.278228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.279645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.289291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 348/678] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:09.290065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.333170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.346600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94348ba0-09f9-46bc-8d07-1992ac065184 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.387335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.388012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.388304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.388619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.389510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:09.389883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.391928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.404789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 331/679] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:09.405559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3db0935-ac16-479d-8924-f650e143eb97 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.405667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.446934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.447644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.447936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.448216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.456377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.458051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:09.473239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:09.474174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:09.475084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 349/680] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:09.475598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.527524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff04492a-aebd-4157-a388-5de08fe51213 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.531612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.567854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.568925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.569358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.569809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.570767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:09.571222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.572868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.586518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 332/681] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:09.586518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.600505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7558b8-9dab-44c7-9f70-937610a29749 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.604161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.642797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.643599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.643893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.644178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.655761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.657441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:09.679306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:09.686027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:09.687016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:09.687016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:09.687016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:09.687016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:09.687016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 350/682] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:09.687016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.715490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d43345-8622-4f7f-ab67-44f2ae563053 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.753993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.754669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.754961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.755249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.756088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=b35298e764904e9884012cafea48a794) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:09.756817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.757969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.772419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 333/683] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/role_assignments?user.id=b35298e764904e9884012cafea48a794&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:09.772419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.801833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.810716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efe99d6-e0f6-4a3b-9176-7ac270f54b34 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.874027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.875257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.875770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.876159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.877739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:09.878164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.879886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:09.880447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.901383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 351/684] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:09.902501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:09.909304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f378a77-a70a-4248-b9f4-119dc70691b3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:09.950762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:09.951563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:09.951853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:09.952136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:09.964017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:09.965693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:09.984360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:09.986074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:09.987532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:09.987532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:09.987532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:09.987532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:09.990933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 334/685] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:09.991847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.027085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dffb6da-65cf-4244-a244-8ff63593fd2a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.078030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.079062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.079512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.080507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.081404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:10.081868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:10.084312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:10.101915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 352/686] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:10.103087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.115026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096397a8-7fd5-46c6-b41f-0a1ebc084dcc None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.123091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:10.152032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:10.166277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.168034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.168543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.168998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.170697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=18e34e8f236f4f09a456e10221e2e416) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:10.171185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:10.174070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:10.189481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 335/687] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:09 2022] GET /identity/v3/role_assignments?user.id=18e34e8f236f4f09a456e10221e2e416&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:10.189481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.299087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb888b-505b-412b-8c2e-bce158f7d5f0 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.342509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.343510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.343901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.344320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.345345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:10.345663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:10.347089 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:10.363351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 353/688] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:10.369226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.433508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e8485-c40c-4f52-92d9-f6bed91ea98e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.458730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:10.494207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.495201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.495488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.496110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.498831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9789b1e3-8a56-4c04-804c-31eba7ff1bab None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.505987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:10.507941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:10.528557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:10.529569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:10.530515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:10.531577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 336/689] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:38:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:10.537279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.544398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.545257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.545589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.545869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.555393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:10.556972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:10.573970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:10.574983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:10.576095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 354/690] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:10.581454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.612120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:10.674177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092d34e-77f2-43d5-8585-76289f13e317 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.722293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.723034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.723335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.723620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.724517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:10.724842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:10.726341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:10.738896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15480245-cf46-4baa-967d-1d1215e0fb7e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.751854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 337/691] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:38:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:10.757382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.780854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc987f02-33f6-4414-ab6c-9393162471d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.781691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc987f02-33f6-4414-ab6c-9393162471d8 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.782735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc987f02-33f6-4414-ab6c-9393162471d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.783122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc987f02-33f6-4414-ab6c-9393162471d8 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.784492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc987f02-33f6-4414-ab6c-9393162471d8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:10.784492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc987f02-33f6-4414-ab6c-9393162471d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:10.786094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc987f02-33f6-4414-ab6c-9393162471d8 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:10.788264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:10.809126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 355/692] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 30 12:38:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:10.810726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0208ed-2c8e-487e-a369-ce3b85e156e2 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.811157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0208ed-2c8e-487e-a369-ce3b85e156e2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.811596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0208ed-2c8e-487e-a369-ce3b85e156e2 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.813759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 356/693] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:10.814802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0208ed-2c8e-487e-a369-ce3b85e156e2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:10.899097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d868207-47f9-491b-b23b-588dc9e2a120 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.911003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:10.938142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f84b9-fea8-45e8-b5f3-b5eed33d7b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.939870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f84b9-fea8-45e8-b5f3-b5eed33d7b80 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.940356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f84b9-fea8-45e8-b5f3-b5eed33d7b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.940868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f84b9-fea8-45e8-b5f3-b5eed33d7b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:10.941037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0208ed-2c8e-487e-a369-ce3b85e156e2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:10.989906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:10.990618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:10.990849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:10.991156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.026095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f84b9-fea8-45e8-b5f3-b5eed33d7b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.027934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f84b9-fea8-45e8-b5f3-b5eed33d7b80 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.077358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.093955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.096296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.143824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 338/694] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 30 12:38:11.145462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9a0a5-f53f-452d-b9e1-585f7d3e0678 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.145868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9a0a5-f53f-452d-b9e1-585f7d3e0678 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.146257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b9a0a5-f53f-452d-b9e1-585f7d3e0678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.164925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c0b9a0a5-f53f-452d-b9e1-585f7d3e0678 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:11.166291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c0b9a0a5-f53f-452d-b9e1-585f7d3e0678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:11.169806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.206533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 357/695] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 30 12:38:11.207402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.246601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 339/696] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:11.247541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9a0a5-f53f-452d-b9e1-585f7d3e0678 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.327884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.337414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664f6bb6-e14c-4be5-b015-0cb6460f7b67 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.363168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b9a0a5-f53f-452d-b9e1-585f7d3e0678 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.373553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:11.374345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.374626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.374896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.385958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.387407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.400608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449fed-d33e-459d-a127-381172053330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:11.401467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449fed-d33e-459d-a127-381172053330 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.401763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449fed-d33e-459d-a127-381172053330 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.402050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6449fed-d33e-459d-a127-381172053330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:11.406345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:11.408029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:11.410043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:11.410043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:11.410043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:11.410043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:11.410043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 358/697] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:11.410043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.415029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.415029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449fed-d33e-459d-a127-381172053330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.416311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6449fed-d33e-459d-a127-381172053330 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-f6449fed-d33e-459d-a127-381172053330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:11.437417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:11.439522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:11.441615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:11.441615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:11.441615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:11.441615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:11.441615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 340/698] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:11.441615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449fed-d33e-459d-a127-381172053330 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.521855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c320705-c426-4c59-942b-5af9161cb34a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.558412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6449fed-d33e-459d-a127-381172053330 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.560643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:11.561589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.561882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.562183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.562841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.565455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:11.583988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:11.586194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:11.588104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:11.596524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 359/699] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:11.596524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.601102 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:11.601985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.602418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.602838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.603734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:11.604205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.606262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.608413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.622568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 341/700] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:11.623524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.690207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.730614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c14039-477d-4e1c-ad94-d629d1948460 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.749101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802a4fc-5e6e-4b8d-9d7d-a9706424cdf5 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.783926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:11.785600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.786138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.786621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.787771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:11.788226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.789047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:11.789833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.790158 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.790269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.790659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.791477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:11.791890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.795193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:11.805611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 342/701] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:11.805611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.813268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 360/702] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:11.814265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:11.909304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.940918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4eb6a7-7323-45b8-a743-100eb9dd4726 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.957055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba77bc58-d1e2-46c2-a2dc-526f693500be None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:11.958991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:11.981355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:11.982191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:11.982482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:11.982768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:11.991070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:11.992823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.002695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:12.003681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.004160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.004666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.005590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:12.006109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:12.007929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:12.009136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:12.009989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:12.010867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 343/703] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:12.011857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:12.018742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 361/704] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 30 12:38:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:12.024398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:12.185440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0034922-89d6-4e7f-963f-74dbf74032bb None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:12.185619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc4a22-ed38-43d5-ad61-b3a5624aa015 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:12.224699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:12.235000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dc93f4-c112-41d4-8932-41dbf0b15de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:12.236129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc93f4-c112-41d4-8932-41dbf0b15de4 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.236670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc93f4-c112-41d4-8932-41dbf0b15de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.236972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dc93f4-c112-41d4-8932-41dbf0b15de4 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.237805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc93f4-c112-41d4-8932-41dbf0b15de4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:12.238208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc93f4-c112-41d4-8932-41dbf0b15de4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:12.239604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dc93f4-c112-41d4-8932-41dbf0b15de4 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.244156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96f622-0f3f-4b20-8987-f3d7cf8fe0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:12.245005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f622-0f3f-4b20-8987-f3d7cf8fe0c0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.245291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f622-0f3f-4b20-8987-f3d7cf8fe0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.245570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96f622-0f3f-4b20-8987-f3d7cf8fe0c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.255451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96f622-0f3f-4b20-8987-f3d7cf8fe0c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:12.256299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 362/705] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:12.256974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96f622-0f3f-4b20-8987-f3d7cf8fe0c0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.257780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19e7e0-8f48-4cbe-8de1-a4caeb0e2fc2 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.258080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19e7e0-8f48-4cbe-8de1-a4caeb0e2fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.258366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e19e7e0-8f48-4cbe-8de1-a4caeb0e2fc2 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.259968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 363/706] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:12.264907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19e7e0-8f48-4cbe-8de1-a4caeb0e2fc2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-6b96f622-0f3f-4b20-8987-f3d7cf8fe0c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:12.281099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:12.282278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:12.283253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:12.283681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 344/707] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:12.285753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65239d-e773-4e46-8ff8-18343c5bd176 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.286328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65239d-e773-4e46-8ff8-18343c5bd176 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.286628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65239d-e773-4e46-8ff8-18343c5bd176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.310112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1d65239d-e773-4e46-8ff8-18343c5bd176 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:12.311334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1d65239d-e773-4e46-8ff8-18343c5bd176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:12.352154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:12.400633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 345/708] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:12.401522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65239d-e773-4e46-8ff8-18343c5bd176 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:12.407589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e19e7e0-8f48-4cbe-8de1-a4caeb0e2fc2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:12.459991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52204934-468b-4195-bef9-48e084579709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:12.460581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52204934-468b-4195-bef9-48e084579709 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.460865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52204934-468b-4195-bef9-48e084579709 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.461155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52204934-468b-4195-bef9-48e084579709 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.462003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52204934-468b-4195-bef9-48e084579709 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=5f39f1ea697c4426b30a5e6fa795e4e4) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:12.462323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52204934-468b-4195-bef9-48e084579709 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:12.463878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52204934-468b-4195-bef9-48e084579709 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.472258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 364/709] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:12 2022] GET /identity/v3/role_assignments?user.id=5f39f1ea697c4426b30a5e6fa795e4e4&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:12.473246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52204934-468b-4195-bef9-48e084579709 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:12.547179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65239d-e773-4e46-8ff8-18343c5bd176 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:12.558321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:12.602887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:12.603574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.603861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.604140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.605006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:12.605323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:12.606843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.637850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 346/710] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:12.643699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:12.678674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52204934-468b-4195-bef9-48e084579709 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:12.703257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:12.728466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:12.737439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.737762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.738024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] PATH_INFO: `/v3/services/network` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.738754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:12.740180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:12.778543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:12.779623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:12.781088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 365/711] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:12 2022] GET /identity/v3/services/network => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:12.785994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:12.803335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c502b6-50a0-4cd0-93ae-1e02b0d7169f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:12.843121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef705754-51f9-4ef0-ae48-778eac626d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:12.844138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705754-51f9-4ef0-ae48-778eac626d84 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.845269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705754-51f9-4ef0-ae48-778eac626d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.845755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef705754-51f9-4ef0-ae48-778eac626d84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.847196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705754-51f9-4ef0-ae48-778eac626d84 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=addf74dd6b6f4f78bace4808bf676acc) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:12.848819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705754-51f9-4ef0-ae48-778eac626d84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:12.850589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef705754-51f9-4ef0-ae48-778eac626d84 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:12.858184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 347/712] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:12 2022] GET /identity/v3/role_assignments?user.id=addf74dd6b6f4f78bace4808bf676acc&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:12.859840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a37de-8f7d-4c6a-9c60-09f2a69dccec None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.860948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a37de-8f7d-4c6a-9c60-09f2a69dccec None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.861598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a37de-8f7d-4c6a-9c60-09f2a69dccec None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.863452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 348/713] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:12.869858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833aa7d-7ac0-4c58-b2a4-27778e536766 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:12.869858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833aa7d-7ac0-4c58-b2a4-27778e536766 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:12.869858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833aa7d-7ac0-4c58-b2a4-27778e536766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:12.892813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d833aa7d-7ac0-4c58-b2a4-27778e536766 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:12.894559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d833aa7d-7ac0-4c58-b2a4-27778e536766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:12.971988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a032b00-401a-47dd-b845-909f0ebc046c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:12.983172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 349/714] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 30 12:38:13.004306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:13.022004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:13.022700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:13.022990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:13.023273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:13.024065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] RBAC: Adding query filter params (name=network) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:13.024408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:13.025842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:13.027631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833aa7d-7ac0-4c58-b2a4-27778e536766 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:13.032563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 366/715] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:12 2022] GET /identity/v3/services?name=network => generated 124 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:13.039800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:13.065756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:13.204198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152483ca-e5fe-4748-afb4-07177541a00e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:13.209884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833aa7d-7ac0-4c58-b2a4-27778e536766 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:13.248024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:13.249131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:13.249624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:13.250102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:13.251073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] RBAC: Adding query filter params (type=network) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:13.251623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:13.252957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:13.253681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:13.253790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:13.254046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:13.254332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:13.261330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 367/716] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:13.267526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:13.271430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:13.289528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:13.290482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:13.291375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:13.291375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:13.291375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:13.291375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:13.293618 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 350/717] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:13.301018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:13.365908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:13.427878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697c0e43-5bc3-4646-8c31-b7d4847a3cdf None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:13.471423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f143a-0067-44e8-86eb-0ba73bd86f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:13.472100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f143a-0067-44e8-86eb-0ba73bd86f9c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:13.472512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f143a-0067-44e8-86eb-0ba73bd86f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:13.472831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f143a-0067-44e8-86eb-0ba73bd86f9c None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:13.473430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f143a-0067-44e8-86eb-0ba73bd86f9c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:13.473745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f143a-0067-44e8-86eb-0ba73bd86f9c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:13.475131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4f143a-0067-44e8-86eb-0ba73bd86f9c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:13.488694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 368/718] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:13.493776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:13.570037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:13.604974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a5256c-73a7-405b-8c9d-55d829ebdd5e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:13.650581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647db5a-1f49-47e7-b8df-589e3d11f5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:13.651535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647db5a-1f49-47e7-b8df-589e3d11f5a2 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:13.651965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647db5a-1f49-47e7-b8df-589e3d11f5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:13.652421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647db5a-1f49-47e7-b8df-589e3d11f5a2 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:13.653277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647db5a-1f49-47e7-b8df-589e3d11f5a2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:13.654854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c647db5a-1f49-47e7-b8df-589e3d11f5a2 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:13.684904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 351/719] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:38:13 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:14.396535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae3e77-a651-4cca-8fed-877c8ad18a91 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:14.397415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae3e77-a651-4cca-8fed-877c8ad18a91 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:14.397853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ae3e77-a651-4cca-8fed-877c8ad18a91 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:14.399600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 369/720] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:14.405222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7799c6-17d4-4353-bd2d-ddf4a50d1870 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:14.406088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7799c6-17d4-4353-bd2d-ddf4a50d1870 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:14.406601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7799c6-17d4-4353-bd2d-ddf4a50d1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:14.424452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2f7799c6-17d4-4353-bd2d-ddf4a50d1870 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:14.425963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2f7799c6-17d4-4353-bd2d-ddf4a50d1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:14.501615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 352/721] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:14.526272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae3e77-a651-4cca-8fed-877c8ad18a91 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:14.638364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ae3e77-a651-4cca-8fed-877c8ad18a91 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:14.649921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:14.681212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f3d615-9024-4da2-886d-a3734c7d1e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:14.682239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3d615-9024-4da2-886d-a3734c7d1e8a None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:14.682723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3d615-9024-4da2-886d-a3734c7d1e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:14.683223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f3d615-9024-4da2-886d-a3734c7d1e8a None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:14.684160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3d615-9024-4da2-886d-a3734c7d1e8a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:14.685754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f3d615-9024-4da2-886d-a3734c7d1e8a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:14.708613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 370/722] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:14 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:14.999051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be403-ac32-4ecc-80a2-b8bb31ca9bd1 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:14.999765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be403-ac32-4ecc-80a2-b8bb31ca9bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:15.000275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92be403-ac32-4ecc-80a2-b8bb31ca9bd1 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:15.002293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 353/723] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:15.011752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd4ef-55ae-439f-a54b-d889475bca09 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:15.012351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd4ef-55ae-439f-a54b-d889475bca09 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:15.012679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4bd4ef-55ae-439f-a54b-d889475bca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:15.038560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-2a4bd4ef-55ae-439f-a54b-d889475bca09 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:15.039778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2a4bd4ef-55ae-439f-a54b-d889475bca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:15.135308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 371/724] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:15.163482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be403-ac32-4ecc-80a2-b8bb31ca9bd1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:15.262686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:15.325115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92be403-ac32-4ecc-80a2-b8bb31ca9bd1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:15.401138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:15.401962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:15.402272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:15.402565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:15.441184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:15.448882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:15.449841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:15.450724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:15.456908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 354/725] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:15.461528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bd4ef-55ae-439f-a54b-d889475bca09 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:15.704834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:15.713204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4bd4ef-55ae-439f-a54b-d889475bca09 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:15.814291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6246d4-4c88-4cfc-9fd7-9e2c7fbb15de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:15.814994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6246d4-4c88-4cfc-9fd7-9e2c7fbb15de None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:15.815288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6246d4-4c88-4cfc-9fd7-9e2c7fbb15de None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:15.815568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6246d4-4c88-4cfc-9fd7-9e2c7fbb15de None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:15.816339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6246d4-4c88-4cfc-9fd7-9e2c7fbb15de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:15.816703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6246d4-4c88-4cfc-9fd7-9e2c7fbb15de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:15.818095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6246d4-4c88-4cfc-9fd7-9e2c7fbb15de None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:15.840042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 372/726] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:15.846158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:15.942046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed865f5e-1fcf-49ad-b9cc-547edd1ba76d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:15.942372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed865f5e-1fcf-49ad-b9cc-547edd1ba76d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:15.942940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed865f5e-1fcf-49ad-b9cc-547edd1ba76d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:15.944358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 373/727] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:15.954119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbcab-46fb-40de-ac52-baffa83e755e None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:15.954394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbcab-46fb-40de-ac52-baffa83e755e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:15.954670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccbcab-46fb-40de-ac52-baffa83e755e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.001803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9dccbcab-46fb-40de-ac52-baffa83e755e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:16.003042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9dccbcab-46fb-40de-ac52-baffa83e755e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:16.098309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a088b9bc-6459-4466-9ed4-a825ef5a6d84 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:16.111416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 374/728] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:15 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:16.112831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d80a-6285-4c71-aae0-0e3330b79dbd None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.113127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d80a-6285-4c71-aae0-0e3330b79dbd None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.113412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670d80a-6285-4c71-aae0-0e3330b79dbd None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.114948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 375/729] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:16.115769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:16.120698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea219f-e8b1-4a1f-921d-1e9606180e78 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.121267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea219f-e8b1-4a1f-921d-1e9606180e78 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.121750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ea219f-e8b1-4a1f-921d-1e9606180e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.138271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:16.139068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.139358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.139642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.141268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e8ea219f-e8b1-4a1f-921d-1e9606180e78 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:16.143494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e8ea219f-e8b1-4a1f-921d-1e9606180e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:16.151763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:16.153407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:16.172034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:16.173659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:16.174680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:16.174680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:16.174680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:16.174680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:16.174680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 355/730] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:16.175560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:16.233441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 376/731] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 30 12:38:16.235116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea219f-e8b1-4a1f-921d-1e9606180e78 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:16.257187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:16.322595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043b7e0f-f4ba-4825-8cb3-b97a6a770809 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:16.348752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ea219f-e8b1-4a1f-921d-1e9606180e78 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:16.358965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:16.360467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.360721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.361107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.372142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:16.380172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:16.381184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:16.382019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:16.386368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 356/732] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:16.387627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:16.393024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:16.394139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.394649 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.395203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.396153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:16.396698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:16.398308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:16.412645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 377/733] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:16.413943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:16.430611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:16.506136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7766e48-ff90-4e36-8f8b-8c2db32d7214 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:16.520869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:16.543137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:16.543807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.544092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.544371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.545121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:16.546077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04a3772-7914-434e-b3f6-f11b13a124d6 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:16.546490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:16.568790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 357/734] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:16 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:16.569822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:16.593289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:16.595187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.597528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.599141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.601699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:16.602331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:16.604539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:16.625217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 378/735] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:16.632549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:16.775765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a3b3-7f83-4472-84ce-8222e5f7f5d9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:16.808971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:16.826895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0facc9d8-6032-494e-93bd-2a8a2fafeaf8 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:16.832330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067818c-564b-4245-8c42-83ef0ab7df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:16.833504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067818c-564b-4245-8c42-83ef0ab7df62 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.833993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067818c-564b-4245-8c42-83ef0ab7df62 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.834472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067818c-564b-4245-8c42-83ef0ab7df62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.837422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:16.851649 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067818c-564b-4245-8c42-83ef0ab7df62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:16.853785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8067818c-564b-4245-8c42-83ef0ab7df62 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:16.873283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:16.874077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.874365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.874645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-8067818c-564b-4245-8c42-83ef0ab7df62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:16.877575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:16.878523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:16.880193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:16.880193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:16.880193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:16.880193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:16.880193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 379/736] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:16.880642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eb73-627c-4113-9980-f15a164b234b None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.881748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eb73-627c-4113-9980-f15a164b234b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.881748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74eb73-627c-4113-9980-f15a164b234b None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.882832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 380/737] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:16.888137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:16.889798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:16.890076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f68c-84b1-4390-89a0-16a07a838fd4 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:16.890237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f68c-84b1-4390-89a0-16a07a838fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:16.890560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47f68c-84b1-4390-89a0-16a07a838fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:16.907687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:16.908889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 358/738] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:38:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:16.909828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:16.911878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-2d47f68c-84b1-4390-89a0-16a07a838fd4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:16.913102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2d47f68c-84b1-4390-89a0-16a07a838fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:16.998849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 381/739] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:16.999798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f68c-84b1-4390-89a0-16a07a838fd4 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.051169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966959b3-e966-4419-ac7a-ddb76888757d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.089294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.090452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.090937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.091447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.092409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:17.092918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.094679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.112792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 359/740] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:17.113440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47f68c-84b1-4390-89a0-16a07a838fd4 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.114352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.135540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:17.136693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:17.166230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.168092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.168092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.168092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.168411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:17.168675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.170596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.204516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 382/741] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:38:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:17.206861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.258924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b285c-3801-4b15-a3ee-f92e0f6bf421 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.300892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.302234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.302658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.303210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.315497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:17.323514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:17.325317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 360/742] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:17.326153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.363242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb9f8dc-a948-496e-ad8b-2ce805aca465 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.411885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:17.412365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.415272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.415817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.416296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.426836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.428640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:17.447716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:17.449383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:17.451114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:17.452516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1f1ec-5fe3-4d9e-a3f9-ab9d6075de70 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.455255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 383/743] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:17.457097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.496112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.496958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.497248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.497528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.498702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:17.512091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.513521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:17.543012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:17.543984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:17.546830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:17.546830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:17.546830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:17.546830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:17.546830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 361/744] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:17.546830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.605123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa14104-6c36-4559-befc-f6709ac8e24b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.661733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a19626-49c3-4c4f-a2f3-e9f760391f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.662428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19626-49c3-4c4f-a2f3-e9f760391f99 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.662799 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19626-49c3-4c4f-a2f3-e9f760391f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.663273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a19626-49c3-4c4f-a2f3-e9f760391f99 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.664340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19626-49c3-4c4f-a2f3-e9f760391f99 None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:17.664697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19626-49c3-4c4f-a2f3-e9f760391f99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.666499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a19626-49c3-4c4f-a2f3-e9f760391f99 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.672684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6bae7d-22ba-44f5-a125-3d1dc198e72c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.683917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 384/745] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:17.685248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb82a5d-e520-4a0a-acd1-67de20cd825d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.685750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb82a5d-e520-4a0a-acd1-67de20cd825d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.686042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb82a5d-e520-4a0a-acd1-67de20cd825d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.689153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 385/746] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:17.689902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb82a5d-e520-4a0a-acd1-67de20cd825d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.711056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:17.729140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.730256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.730679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.730970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.732074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:17.732736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.734900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.760430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 362/747] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 30 12:38:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:17.760430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:17.832486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:17.841956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb82a5d-e520-4a0a-acd1-67de20cd825d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.884244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b31b9c-b23c-4233-8e9b-cdb551310532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.884865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31b9c-b23c-4233-8e9b-cdb551310532 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.885171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31b9c-b23c-4233-8e9b-cdb551310532 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.885437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31b9c-b23c-4233-8e9b-cdb551310532 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.886163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b31b9c-b23c-4233-8e9b-cdb551310532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:17.887103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b31b9c-b23c-4233-8e9b-cdb551310532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.888005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b31b9c-b23c-4233-8e9b-cdb551310532 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.891263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d21cfb-64b1-45e5-93bf-71f519749196 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:17.908462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 386/748] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:17.908462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef88c6c-1eb6-442b-996c-d07d19eed34d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.908462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef88c6c-1eb6-442b-996c-d07d19eed34d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.908462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef88c6c-1eb6-442b-996c-d07d19eed34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.931781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-eef88c6c-1eb6-442b-996c-d07d19eed34d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:17.933733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-eef88c6c-1eb6-442b-996c-d07d19eed34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:17.942085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:17.942888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:17.943182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:17.945188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:17.961532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:17.964101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:17.999387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:18.001148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:18.002175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:18.002175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:18.002175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:18.002175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:18.007173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 363/749] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:18.007173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.033618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 387/750] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:18.034474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef88c6c-1eb6-442b-996c-d07d19eed34d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.054281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.136983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.144010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59383818-eb74-401a-b0df-b27f57752313 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.156230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef88c6c-1eb6-442b-996c-d07d19eed34d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.182087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.182750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.183034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.183316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.196734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.197798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.198000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.198297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.206696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.208155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:18.223488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:18.224483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 388/751] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:18.230917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.264784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.267149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.299280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.352418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d5d74d-2b47-470c-aece-5f91d51654d7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.392768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.393356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.393648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.393933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.394676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:18.394987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.395955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 364/752] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:38:18.397730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.397850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.410096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 389/753] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:18.410881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.423829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.535323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f8a71-6e77-43bd-ab52-c7ac5ad3e4a2 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.543990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d2da64-c027-430c-a2cc-cb76fea9e4a5 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.568895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.574060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.574876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.575162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.575546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.576100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.577572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.586297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.587028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.587319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.587604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.588485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:18.588809 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.590239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:18.591774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:18.592722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:18.593564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 365/754] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:18.595239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.609432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 390/755] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:18.611729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.687126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.721979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4120e43-a8df-45d1-ae11-3c0a9f464304 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.726217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d739b6-d580-41c3-b454-f45cba764b3b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.762143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.762936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.763226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.763501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.763626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.764358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.764678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.764965 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.773768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.774861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.775210 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.776310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:18.791224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:18.792340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:18.793381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:18.796815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 391/756] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:18.798229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:18.914096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:18.915441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:18.916334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:18.916334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:18.916334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:18.916334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:18.916334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 366/757] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:18.916334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:18.931656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cbdb8e-687d-48aa-ba47-4a0123b5810d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:18.963917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.975036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:18.975719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:18.975990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:18.976267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:18.977006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:18.977314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:18.977899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:18.978692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:18.983754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 392/758] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:18.984625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.041162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb4a8e8-87ba-4822-83e9-96e6123a9475 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.079713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.080736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.081018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.081296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/5f39f1ea697c4426b30a5e6fa795e4e4/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.083368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=5f39f1ea697c4426b30a5e6fa795e4e4, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.084842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.095671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a500bff-40fb-4af8-91ce-014c30e30d3a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.108417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 367/759] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:18 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/5f39f1ea697c4426b30a5e6fa795e4e4/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:38:19.108417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.144657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.145557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.145911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.146314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.147323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:19.147720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.149678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.175600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 393/760] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 30 12:38:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:19.175600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.241265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:19.264592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c9df1-9de5-4435-a0cc-f34373f4bbbc None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.278414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:19.309468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f951c98c-be90-48be-a30d-1ddfe58db36d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.313721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.314604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.315038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.315462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.316370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:19.316855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.318413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.332128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 368/761] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:19.333334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.348623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.349294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.349580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.349858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.350622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:19.350936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.352351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.363245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 394/762] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:19.364252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.473461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688cea30-73ae-4f79-8cc8-176fe351865a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.477780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b5881-e4db-4989-952a-64543f97c2e9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.491757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:19.514500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.515302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.515503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8a80c-ff54-45a9-8ad2-7d7397352a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.515640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.515887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.516871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8a80c-ff54-45a9-8ad2-7d7397352a2c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.517081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8a80c-ff54-45a9-8ad2-7d7397352a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.517616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8a80c-ff54-45a9-8ad2-7d7397352a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.525411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.527401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:19.546836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:19.548949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 395/763] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:19.550268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.556585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:19.596936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8a80c-ff54-45a9-8ad2-7d7397352a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.598410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8a80c-ff54-45a9-8ad2-7d7397352a2c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.686628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635863f8-19f7-4ba3-8cf0-0a70d1aecec1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.725085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 369/764] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:38:19.725085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ba2b-193c-4023-bcce-8fe7f2316096 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.725085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ba2b-193c-4023-bcce-8fe7f2316096 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.725085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350ba2b-193c-4023-bcce-8fe7f2316096 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.725085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 370/765] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:19.725085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ba2b-193c-4023-bcce-8fe7f2316096 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.730025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.730706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.730996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.731274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.732079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] RBAC: Adding query filter params (interface=public, service_id=ccabb787d6144ee29c50311031a16bb6, region_id=RegionOne) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:19.732420 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.733805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.746367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 396/766] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/endpoints?service_id=ccabb787d6144ee29c50311031a16bb6&interface=public®ion_id=RegionOne => generated 194 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:19.746367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.782972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:19.811683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:19.850703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350ba2b-193c-4023-bcce-8fe7f2316096 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.860431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c746f6-aa82-4d35-bde0-024168b61978 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:19.890490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50a7b3-92bf-4aad-845b-c41b5ba59e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.892036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50a7b3-92bf-4aad-845b-c41b5ba59e8d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.892829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50a7b3-92bf-4aad-845b-c41b5ba59e8d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.893280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50a7b3-92bf-4aad-845b-c41b5ba59e8d None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.894383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50a7b3-92bf-4aad-845b-c41b5ba59e8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:19.894871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50a7b3-92bf-4aad-845b-c41b5ba59e8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.896713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50a7b3-92bf-4aad-845b-c41b5ba59e8d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.897634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:19.898438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.898733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.899014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.912442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:19.913279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:19.915446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 371/767] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:19.916905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b7c1a-0372-4af9-8ba9-0a2fb7ed46cb None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:19.917200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b7c1a-0372-4af9-8ba9-0a2fb7ed46cb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:19.917479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0b7c1a-0372-4af9-8ba9-0a2fb7ed46cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:19.931599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:19.932709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:19.933706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:19.933706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:19.933706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:19.933706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:19.933706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 397/768] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:19.934438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:19.938395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-8d0b7c1a-0372-4af9-8ba9-0a2fb7ed46cb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:19.939650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8d0b7c1a-0372-4af9-8ba9-0a2fb7ed46cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:20.012993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 372/769] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:20.014189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b7c1a-0372-4af9-8ba9-0a2fb7ed46cb None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.046554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:20.061813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac698af9-375f-4479-9d0e-cd52e07d07f3 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.080570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:20.102215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.103328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.103632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.104239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.105128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.106515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.113385 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 398/770] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:38:19 2022] GET /identity/v3/services => generated 772 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:20.114192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.141251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0b7c1a-0372-4af9-8ba9-0a2fb7ed46cb None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.188576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.189262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.189552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.189833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.190700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=addf74dd6b6f4f78bace4808bf676acc) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:20.191087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.192718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.199662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 373/771] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/role_assignments?user.id=addf74dd6b6f4f78bace4808bf676acc&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:20.200654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.340932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe23b3-e351-4340-bcd1-001ad7031d31 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.354445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8eb39b4-714c-44a0-aeaf-6f98f28ad4cd None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.380866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:20.396009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.397433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.397433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.397433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] PATH_INFO: `/v3/services/network` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.398058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.399520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.409303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.410287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.410771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.411267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.412199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:20.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:20.414272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:20.415130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:20.415912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.415912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.416038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 374/772] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:20.422032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.431936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 399/773] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:20.437307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.458525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:20.605826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0829aa8-48c2-4fe6-bf63-325a92c2867d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.610520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0306563c-1a87-4f25-8d33-c935c0976561 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.647703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.648956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.649401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.649829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.650881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] RBAC: Adding query filter params (name=network) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:20.651342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.652898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.659046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 375/774] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:20.670659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.712359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.713996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.714459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.714891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.723906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.725616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:20.742564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:20.743711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:20.744817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:20.747318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 400/775] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:20.753616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.807847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:20.835955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:20.869206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0beef75b-93c8-44c6-9750-33dd64038bab None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.906989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.908110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.908421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.908715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.909549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:20.909869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.911564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.923533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41d932-3c33-42b7-8fdc-3686956b5b15 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:20.926588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 401/776] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:20.933054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:20.976522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:20.977204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:20.977489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:20.977766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:20.978474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] RBAC: Adding query filter params (type=network) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:20.978820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:20.980189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:20.988173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 376/777] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:20.994286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:21.164911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8b695-fe9a-4980-bb8e-9c0621824885 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:21.168591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877c813-d54c-4bec-9559-7bbc36e65172 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:21.194126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:21.229713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:21.230377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:21.230659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:21.230934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:21.231926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] RBAC: Adding query filter params (interface=public, service_id=5ea64c967066411383af39a957446e60, region_id=RegionOne) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:21.233061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:21.233937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:21.237239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:21.243749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9605e861-0941-413a-abe5-df64edcf361c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:21.244419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605e861-0941-413a-abe5-df64edcf361c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:21.244740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605e861-0941-413a-abe5-df64edcf361c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:21.245204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9605e861-0941-413a-abe5-df64edcf361c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:21.246043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605e861-0941-413a-abe5-df64edcf361c None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=8ffd5ef5211d42f8b7ba6000166d1a41) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:21.249041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605e861-0941-413a-abe5-df64edcf361c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:21.250987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9605e861-0941-413a-abe5-df64edcf361c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:21.257165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 377/778] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/endpoints?service_id=5ea64c967066411383af39a957446e60&interface=public®ion_id=RegionOne => generated 194 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:21.261945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 402/779] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:20 2022] GET /identity/v3/role_assignments?user.id=8ffd5ef5211d42f8b7ba6000166d1a41&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 259 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:21.266824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:21.320091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52eb83-2f38-4ef3-af2b-b3a37d96c3af None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:21.320442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52eb83-2f38-4ef3-af2b-b3a37d96c3af None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:21.320674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea52eb83-2f38-4ef3-af2b-b3a37d96c3af None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:21.322343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 403/780] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:21.329789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9a31b-fc39-4c9b-831d-38ce76f5f916 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:21.330096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9a31b-fc39-4c9b-831d-38ce76f5f916 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:21.330358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9a31b-fc39-4c9b-831d-38ce76f5f916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:21.373518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-38d9a31b-fc39-4c9b-831d-38ce76f5f916 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:21.377918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-38d9a31b-fc39-4c9b-831d-38ce76f5f916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:21.434302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664d98ac-88c5-4c96-94f1-fddc92b5fadf None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:21.491014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 404/781] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:21.499827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:21.501168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:21.501456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:21.501739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:21.502446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:21.504033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:21.510690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 378/782] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:38:21 2022] GET /identity/v3/services => generated 772 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:21.537235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9a31b-fc39-4c9b-831d-38ce76f5f916 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:21.657529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9a31b-fc39-4c9b-831d-38ce76f5f916 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:21.700874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:21.710694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:21.711518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:21.711808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:21.712091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:21.724018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:21.731959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:21.732990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:21.734434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 405/783] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:21.740690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:21.797907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:21.865089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376518bc-16c3-42b3-88d6-7db65c0067aa None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:21.900476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:21.901155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:21.901443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:21.901725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:21.902478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:21.902788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:21.904155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:21.913683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 379/784] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:21.919265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:22.032933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13625350-2393-42f0-b5a9-b493d1a43276 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:22.081112 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:22.081925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.082215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.082496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.098576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:22.100428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:22.126316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:22.127264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:22.128154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:22.128154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:22.128154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:22.128154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:22.130137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 406/785] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:22.135762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:22.299576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6f843d-dbdd-4bec-92b0-54ccb583632d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:22.302167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:22.350098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb6756e-ffcd-4241-a4b1-4e2b7ee0e228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:22.350776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6756e-ffcd-4241-a4b1-4e2b7ee0e228 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.351061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6756e-ffcd-4241-a4b1-4e2b7ee0e228 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.351335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb6756e-ffcd-4241-a4b1-4e2b7ee0e228 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.352069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6756e-ffcd-4241-a4b1-4e2b7ee0e228 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:22.352374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6756e-ffcd-4241-a4b1-4e2b7ee0e228 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:22.353770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb6756e-ffcd-4241-a4b1-4e2b7ee0e228 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:22.371916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 380/786] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:22.377237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:22.447566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:22.537985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b292e7e1-e584-42db-bc29-57c98fe8e815 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:22.582925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:22.584078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.584607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.585078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.598778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:22.600673 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:22.608643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183925-5cdf-45a0-ab6a-c47ef218249e None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.609050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183925-5cdf-45a0-ab6a-c47ef218249e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.609522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183925-5cdf-45a0-ab6a-c47ef218249e None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.612136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 381/787] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:22.619570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf049-298f-43f1-8f70-ef535e6be114 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.619875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf049-298f-43f1-8f70-ef535e6be114 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.620136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf049-298f-43f1-8f70-ef535e6be114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:22.624590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:22.626041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:22.626979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:22.629681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 407/788] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:38:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:22.637429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:22.639937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-eb0bf049-298f-43f1-8f70-ef535e6be114 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:22.641298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-eb0bf049-298f-43f1-8f70-ef535e6be114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:22.736752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 382/789] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:22.760236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bf049-298f-43f1-8f70-ef535e6be114 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:22.857849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:22.864801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bf049-298f-43f1-8f70-ef535e6be114 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:22.874853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:22.880787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d8e93-1c1f-4b68-93b9-9c7a0f87ca5f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:22.901531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d9e7d-de8c-40d2-a612-a68515de0ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:22.902605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d9e7d-de8c-40d2-a612-a68515de0ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.903136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d9e7d-de8c-40d2-a612-a68515de0ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.903558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d9e7d-de8c-40d2-a612-a68515de0ee5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.904354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d9e7d-de8c-40d2-a612-a68515de0ee5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:22.905903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d9e7d-de8c-40d2-a612-a68515de0ee5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-809d9e7d-de8c-40d2-a612-a68515de0ee5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:22.918901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:22.920040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 30 12:38:22.921090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:22.921922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb017ba-141b-47fd-a426-7ccb20adf049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:22.921922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb017ba-141b-47fd-a426-7ccb20adf049 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.921922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb017ba-141b-47fd-a426-7ccb20adf049 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.921922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb017ba-141b-47fd-a426-7ccb20adf049 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.922720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb017ba-141b-47fd-a426-7ccb20adf049 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:22.922796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb017ba-141b-47fd-a426-7ccb20adf049 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:22.924243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb017ba-141b-47fd-a426-7ccb20adf049 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:22.928731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 383/790] 10.222.0.20 () {56 vars in 1129 bytes} [Thu Jun 30 12:38:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:22.934820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cbf9-7cde-47ea-86d2-fc1a1af7ceeb None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.935503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cbf9-7cde-47ea-86d2-fc1a1af7ceeb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.935966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1954cbf9-7cde-47ea-86d2-fc1a1af7ceeb None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.937925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 384/791] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:22.938888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954cbf9-7cde-47ea-86d2-fc1a1af7ceeb None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:22.949662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 408/792] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:38:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:22.951034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c29d-cb91-4419-bc89-8ac1fbca0c6f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:22.951333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c29d-cb91-4419-bc89-8ac1fbca0c6f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:22.951927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b56c29d-cb91-4419-bc89-8ac1fbca0c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:22.973057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7b56c29d-cb91-4419-bc89-8ac1fbca0c6f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:22.974670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7b56c29d-cb91-4419-bc89-8ac1fbca0c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:23.052660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 409/793] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:23.053717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c29d-cb91-4419-bc89-8ac1fbca0c6f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.095290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1954cbf9-7cde-47ea-86d2-fc1a1af7ceeb None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.139980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.141202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.141782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.142161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.143292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:23.143667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:23.145201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:23.150820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 385/794] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 30 12:38:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:23.151857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.175886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:23.183495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:23.195727 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b56c29d-cb91-4419-bc89-8ac1fbca0c6f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.233222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.233908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.234195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.234982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.279909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0503f1c4-53da-491b-8787-f9cd6b40318d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.318165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.319085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.319377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.319656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.321710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:23.323550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:23.331048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:23.339148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:23.341217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 386/795] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:23.343118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.443101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:23.443359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:23.462876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 410/796] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:38:23.463822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.464579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb8ec16-d0c8-441d-85b3-02dc7f93eec1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.502806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.503491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.503782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.504066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.504818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:23.505138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:23.506526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:23.512234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 387/797] 10.222.0.20 () {56 vars in 1124 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:23.513143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.572111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f876987-37b5-4226-803d-8dcd52cdd806 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.609670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.610469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.610750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.611030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.611793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:23.612102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:23.613676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:23.623363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 411/798] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:23.624518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.628542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e705e-d25f-43ae-a6d8-e23d85c4a7f4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.682651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.683473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.683760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.684039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.696719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:23.703852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:23.707111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:23.715230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:23.728749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:23.729912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:23.730885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:23.730885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:23.730885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:23.730885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:23.732901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 388/799] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:23.734076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.759745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52182089-03a0-4df6-a4da-d85fc944abc3 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.800175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.801127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.801609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.802136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.803165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:23.804967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:23.830197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 412/800] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:38:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:23.831785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:23.854292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882aa511-8225-4e68-aa21-517727549f47 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:23.912941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:23.917236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:23.918801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:23.919318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:23.936979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:23.939590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:23.960627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:23.961542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:23.962432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:23.962432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:23.962432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:23.962432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:23.964908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 389/801] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:23.971590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.026664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.065311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bdc58c-ca50-4def-93ba-fb244f322474 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.069641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.102346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0730e-c8b8-4aeb-8791-1da8ec7e6e62 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.113464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374f27d0-c903-4573-994a-2c287409c5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.115330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f27d0-c903-4573-994a-2c287409c5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.115879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f27d0-c903-4573-994a-2c287409c5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.116360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374f27d0-c903-4573-994a-2c287409c5b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.117327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f27d0-c903-4573-994a-2c287409c5b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:24.117848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f27d0-c903-4573-994a-2c287409c5b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.119512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374f27d0-c903-4573-994a-2c287409c5b7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.134490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 413/802] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:24.135964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989b14c-3a4e-44bb-b1f7-d71b24208af1 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.136373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989b14c-3a4e-44bb-b1f7-d71b24208af1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.136782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989b14c-3a4e-44bb-b1f7-d71b24208af1 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.138371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 414/803] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:24.139573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989b14c-3a4e-44bb-b1f7-d71b24208af1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.148244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b323f5-9cc7-4603-87ce-4bd4e3a8888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.148957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b323f5-9cc7-4603-87ce-4bd4e3a8888d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.149246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b323f5-9cc7-4603-87ce-4bd4e3a8888d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.149524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b323f5-9cc7-4603-87ce-4bd4e3a8888d None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.150261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b323f5-9cc7-4603-87ce-4bd4e3a8888d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:24.150572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b323f5-9cc7-4603-87ce-4bd4e3a8888d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.152255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b323f5-9cc7-4603-87ce-4bd4e3a8888d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.166842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 390/804] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:24.168402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec800-3c10-4057-994a-6b918181c72a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.168706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec800-3c10-4057-994a-6b918181c72a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.169840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faec800-3c10-4057-994a-6b918181c72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.188820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6faec800-3c10-4057-994a-6b918181c72a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:24.190133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6faec800-3c10-4057-994a-6b918181c72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:24.260195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989b14c-3a4e-44bb-b1f7-d71b24208af1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.271275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 391/805] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:24.280519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c6c2-5342-41c3-a280-f178742d3aba None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.280519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c6c2-5342-41c3-a280-f178742d3aba None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.280519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed9c6c2-5342-41c3-a280-f178742d3aba None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.280519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 392/806] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:24.280519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c6c2-5342-41c3-a280-f178742d3aba None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.299226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64fd3c8-23e3-4adf-84d1-a113804b3c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.300035 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fd3c8-23e3-4adf-84d1-a113804b3c7e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.300325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fd3c8-23e3-4adf-84d1-a113804b3c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.300634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64fd3c8-23e3-4adf-84d1-a113804b3c7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.307733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fd3c8-23e3-4adf-84d1-a113804b3c7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.309212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64fd3c8-23e3-4adf-84d1-a113804b3c7e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-c64fd3c8-23e3-4adf-84d1-a113804b3c7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:24.324702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:24.325635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:24.326515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 415/807] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:24.327334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4ce11-afbb-4b91-a19e-ae10113409de None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.327435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4ce11-afbb-4b91-a19e-ae10113409de None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.327673 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d4ce11-afbb-4b91-a19e-ae10113409de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.340368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.346559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-d3d4ce11-afbb-4b91-a19e-ae10113409de None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:24.347871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d3d4ce11-afbb-4b91-a19e-ae10113409de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:24.366500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.416790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed9c6c2-5342-41c3-a280-f178742d3aba None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.427567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 416/808] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:24.427567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4ce11-afbb-4b91-a19e-ae10113409de None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.458170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.459294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.459829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.460260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.469053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.470889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:24.488197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:24.494686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 393/809] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:24.495664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.552501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d4ce11-afbb-4b91-a19e-ae10113409de None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.591464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.592255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.592566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.592857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.598409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.604809 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:24.604968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bd45ea-cc5d-4a30-acfa-fc9350db8acc None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:24.613193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:24.614691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 417/810] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:24.615651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.638162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.654264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.654932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.655217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.655492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.656936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:24.657492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.659062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.671605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 394/811] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:24.672660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.732830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed40b0e2-f4d7-4af2-b359-a431bbdfa5ab None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.771399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.772206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.772545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.772824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] PATH_INFO: `/v3/services/network` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.773482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.774871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.786395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269a2a-e8ff-4c7c-a14a-fdf7969b0fbf None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:24.787509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:24.788498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:24.789319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 418/812] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/services/network => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:24.790099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.831554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.832154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.832464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.832747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.833594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:24.833907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.835355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.853437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 395/813] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:24.854265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:24.870458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.891745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:24.920529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a04b07-73e9-4b64-a093-5beb54aad130 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.960586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:24.961266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:24.961610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:24.961895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:24.962635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:24.962942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:24.964318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:24.969511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12763b53-5e71-4c7d-a565-93b51ef192eb None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:24.977792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 419/814] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:24.977792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.007865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.008554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.008919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.009201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.009937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=5f39f1ea697c4426b30a5e6fa795e4e4) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:25.010251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.011691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.018703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 396/815] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/role_assignments?user.id=5f39f1ea697c4426b30a5e6fa795e4e4&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:25.022000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.094307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ec2779-9461-4ee6-9c56-be411e8af46b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.131299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:25.140305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.141169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.141962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.142506 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.143239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] RBAC: Adding query filter params (name=network) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:25.143617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.145057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.155389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 420/816] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:25.156561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.160772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:25.161685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0e2ab-7951-453f-867a-dfab9bd3d253 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.207075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.208188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.208691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.209167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.221837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.223880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:25.246369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:25.247338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:25.248206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:25.248206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:25.248206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:25.248206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:25.248731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 397/817] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:25.249384 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.281679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a98327-4276-4e1c-9c75-64dbee8f288e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.327465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.328808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.329095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.329365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.343150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.345417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:25.363961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:25.365218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:25.366111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:25.366111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:25.366111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:25.366111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:25.366111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 421/818] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:25.366721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.385945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448cc62a-13fb-4829-8f25-43b6c24e85c1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.418302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:25.425952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:25.427209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.428133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.428732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.429205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.430185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] RBAC: Adding query filter params (type=network) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:25.430769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.432361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.439787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 398/819] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:25.441011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.475023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80cf2cd-0eff-452e-a020-f64d6935fb2e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.511690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.512376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.512700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.512980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.513703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:25.514015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.515542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.534195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 422/820] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:25.535382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.555616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71ce0a-2701-4edb-ae14-a5715147991b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.593640 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.595237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.595776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.596251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.597357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:25.597941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.599513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.613525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 399/821] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:25.614762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.642058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c621c051-2e50-446b-806b-4ab183154b0f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.661031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:25.683900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.684641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.684931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.685201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.685722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:25.685953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.687324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.713198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 423/822] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:38:25 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:25.714050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.779400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90b226f-218d-41e1-a17e-2d3efe66909a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.859096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6724d49-2278-4601-9da5-5302be36ade3 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:25.881165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.881983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.882274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.882555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.900011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:25.901062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:25.901196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.901362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:25.901651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:25.902549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.911911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:25.913485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:25.927053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:25.927988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:25.928904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 400/823] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:25.934162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:25.936121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:25.937344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 424/824] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:25.938177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.943012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:25.983406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:26.077936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d0e2b3-2fed-4fc7-bcfd-f25afd5445e4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.086776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5feefa0-e901-4a2a-8505-e03e182bb296 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.095135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:26.123941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.125674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.126457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.127150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.128585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:26.129120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.130923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.133443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.134165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.134449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.134760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.135996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:26.136308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.138372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.150582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 401/825] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:26.158486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:26.161302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 425/826] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 30 12:38:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:26.166714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:26.270296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:26.283478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6c9f59-862e-4ca2-bffc-36251092fe3f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.288642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37f1821-7b2d-4084-b287-c5e47c0d11ae None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.324318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6128f51a-23ee-446e-b355-fc513bd56047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.325247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128f51a-23ee-446e-b355-fc513bd56047 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.325530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128f51a-23ee-446e-b355-fc513bd56047 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.325805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6128f51a-23ee-446e-b355-fc513bd56047 None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/addf74dd6b6f4f78bace4808bf676acc/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.327253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.327817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128f51a-23ee-446e-b355-fc513bd56047 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=addf74dd6b6f4f78bace4808bf676acc, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.328054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.328563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.329269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.329382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6128f51a-23ee-446e-b355-fc513bd56047 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.341071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.342541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.343667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 402/827] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:26 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/addf74dd6b6f4f78bace4808bf676acc/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:38:26.345879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545efff-bbdb-4b38-8a5c-189a9bb9c73b None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.346251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545efff-bbdb-4b38-8a5c-189a9bb9c73b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.346633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545efff-bbdb-4b38-8a5c-189a9bb9c73b None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.348229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 403/828] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:26.354078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfdeca-9194-489a-bda3-c36ae71c6b99 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.354715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfdeca-9194-489a-bda3-c36ae71c6b99 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.355172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfdeca-9194-489a-bda3-c36ae71c6b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:26.372277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:26.373339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:26.374281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:26.374281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:26.374281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:26.374281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:26.374281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 426/829] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:26.379100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-10cfdeca-9194-489a-bda3-c36ae71c6b99 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:26.379616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:26.380829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-10cfdeca-9194-489a-bda3-c36ae71c6b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:26.432212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:26.496589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 404/830] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:26 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:26.518235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d588c-0742-4d67-9317-de578d2e6b66 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.519744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfdeca-9194-489a-bda3-c36ae71c6b99 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:26.576005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.577089 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.577512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.577941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.580082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:26.580607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.582637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.593500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:26.604624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 427/831] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:26.612437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:26.654401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfdeca-9194-489a-bda3-c36ae71c6b99 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.694367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.695372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.695759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.696142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.700260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.700260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:26.712251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:26.713528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:26.714571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:26.716170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 405/832] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:26.726143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:26.731922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ceb80b-889d-45f0-9569-7c6e9f14d912 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.762029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:26.772057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.773328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.773760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.774984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.784306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.786327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.852894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd32241-a94d-4b1e-b500-99252bfd6c87 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:26.898216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:26.899708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:26.900170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:26.900653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:26.901537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:26.901998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:26.903598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:26.909914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 406/833] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:26.915873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:26.935081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:26.936239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:26.937181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 428/834] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:26.942154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:27.021991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:27.046689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:27.057713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafbc639-cc24-483d-a6e6-34af99a1e4ad None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:27.077490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eef6d79-75be-44a5-a114-63393bb8aa89 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:27.095640 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:27.096519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:27.096921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:27.097299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:27.098122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:27.098540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:27.100017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:27.110005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 407/835] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:27.126496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4137afe2-2889-458b-af28-f5567568cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:27.127194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137afe2-2889-458b-af28-f5567568cd41 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:27.127490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137afe2-2889-458b-af28-f5567568cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:27.127776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4137afe2-2889-458b-af28-f5567568cd41 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:27.128616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137afe2-2889-458b-af28-f5567568cd41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:27.128941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137afe2-2889-458b-af28-f5567568cd41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:27.130428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4137afe2-2889-458b-af28-f5567568cd41 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:27.144690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 429/836] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:27.150695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:27.269096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df81dc2a-39d2-4a18-8480-d557f2b4337b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:27.306806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a339fc12-c9ec-466b-9193-d60ad24b52db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:27.307721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fc12-c9ec-466b-9193-d60ad24b52db None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:27.308014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fc12-c9ec-466b-9193-d60ad24b52db None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:27.308296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a339fc12-c9ec-466b-9193-d60ad24b52db None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/8ffd5ef5211d42f8b7ba6000166d1a41/roles/9637b53466484a69b2e09ccf4a649721` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:27.326505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339fc12-c9ec-466b-9193-d60ad24b52db None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=8ffd5ef5211d42f8b7ba6000166d1a41, role_id=9637b53466484a69b2e09ccf4a649721)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:27.328189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a339fc12-c9ec-466b-9193-d60ad24b52db None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:27.344230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 408/837] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:27 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/8ffd5ef5211d42f8b7ba6000166d1a41/roles/9637b53466484a69b2e09ccf4a649721 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:38:27.591145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a06c7-3f79-4894-9f85-2ba34a8c439c None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:27.591342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a06c7-3f79-4894-9f85-2ba34a8c439c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:27.591630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96a06c7-3f79-4894-9f85-2ba34a8c439c None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:27.593481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 430/838] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:27.601299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0581-e051-45cb-83d9-40c28c1f5f1c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:27.601741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0581-e051-45cb-83d9-40c28c1f5f1c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:27.602122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cff0581-e051-45cb-83d9-40c28c1f5f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:27.614900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:27.622576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-4cff0581-e051-45cb-83d9-40c28c1f5f1c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:27.624783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4cff0581-e051-45cb-83d9-40c28c1f5f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:27.701837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 409/839] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:27 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:27.726922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a06c7-3f79-4894-9f85-2ba34a8c439c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:27.844550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96a06c7-3f79-4894-9f85-2ba34a8c439c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:27.863400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:27.881751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:27.882813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:27.883116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:27.883400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:27.884065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:27.885476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:27.898729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:27.899701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:27.900966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 431/840] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jun 30 12:38:27 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:27.906741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff0581-e051-45cb-83d9-40c28c1f5f1c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:28.011870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cff0581-e051-45cb-83d9-40c28c1f5f1c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:28.048854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6280eed-c70d-4d0d-bf51-54c37b7a4d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:28.049542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280eed-c70d-4d0d-bf51-54c37b7a4d83 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:28.049830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280eed-c70d-4d0d-bf51-54c37b7a4d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:28.050114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6280eed-c70d-4d0d-bf51-54c37b7a4d83 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:28.050852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280eed-c70d-4d0d-bf51-54c37b7a4d83 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:28.051229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280eed-c70d-4d0d-bf51-54c37b7a4d83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:28.052714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6280eed-c70d-4d0d-bf51-54c37b7a4d83 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:28.058223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 410/841] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:27 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:28.060742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:28.064518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:28.177679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a18d82-b5f7-4c13-a169-7f711eee35ae None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:28.213528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01f318c-9fae-4678-8ab5-bc5afa881e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:28.214201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f318c-9fae-4678-8ab5-bc5afa881e78 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:28.214545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f318c-9fae-4678-8ab5-bc5afa881e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:28.214832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01f318c-9fae-4678-8ab5-bc5afa881e78 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:28.215584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f318c-9fae-4678-8ab5-bc5afa881e78 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:28.215897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f318c-9fae-4678-8ab5-bc5afa881e78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:28.217337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01f318c-9fae-4678-8ab5-bc5afa881e78 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:28.222884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 432/842] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:28 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:28.592932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920e39-fc37-4223-884b-102fcb354637 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:28.593325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920e39-fc37-4223-884b-102fcb354637 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:28.593542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8920e39-fc37-4223-884b-102fcb354637 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:28.596970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 411/843] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:28.602496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d047-e49e-43d6-b24f-bc6d4694011c None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:28.602796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d047-e49e-43d6-b24f-bc6d4694011c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:28.603083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336d047-e49e-43d6-b24f-bc6d4694011c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:28.620489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-d336d047-e49e-43d6-b24f-bc6d4694011c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:28.621722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d336d047-e49e-43d6-b24f-bc6d4694011c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:28.688779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:28.717838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 433/844] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:28 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:28.741739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8920e39-fc37-4223-884b-102fcb354637 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:28.866592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8920e39-fc37-4223-884b-102fcb354637 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:28.907899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:28.908844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:28.909052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:28.909347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:28.922715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:28.930589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:28.932698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:28.934237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 412/845] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:28.938352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d047-e49e-43d6-b24f-bc6d4694011c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.064156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336d047-e49e-43d6-b24f-bc6d4694011c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:29.101160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:29.101832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.102117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.102395 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.103147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:29.103459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:29.105303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:29.115564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 434/846] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:29.121173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.188939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:29.235500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65b695b-3368-472c-bb5d-ea81dbd82dfb None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:29.273061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e446b-1ec4-48b7-8d68-db5ab522f8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:29.274202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e446b-1ec4-48b7-8d68-db5ab522f8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.274721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e446b-1ec4-48b7-8d68-db5ab522f8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.275184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e446b-1ec4-48b7-8d68-db5ab522f8d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.288324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e446b-1ec4-48b7-8d68-db5ab522f8d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:29.290114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e446b-1ec4-48b7-8d68-db5ab522f8d6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-280e446b-1ec4-48b7-8d68-db5ab522f8d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:29.308721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:29.309691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:29.310582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:29.310582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:29.310582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:29.310582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:29.313153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 413/847] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:29.318992 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.363996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:29.435769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a2b29-d488-4024-a25a-18f857660a10 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:29.441730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4feffd-9ab1-461b-a853-ea901f711c24 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.441730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4feffd-9ab1-461b-a853-ea901f711c24 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.441730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4feffd-9ab1-461b-a853-ea901f711c24 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.443311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 414/848] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:29.449093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5989d2-78be-46a1-ac96-e51a6579f272 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.449383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5989d2-78be-46a1-ac96-e51a6579f272 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.449664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5989d2-78be-46a1-ac96-e51a6579f272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.467701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5f5989d2-78be-46a1-ac96-e51a6579f272 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:29.469477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5f5989d2-78be-46a1-ac96-e51a6579f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:29.479721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:29.480681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.481218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.481745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.482734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:29.483317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:29.485690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:29.499717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 435/849] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:29.505764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.574112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 415/850] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:29.575362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b811f-0c00-4b64-84c8-7d0bef9a6de0 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.575656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b811f-0c00-4b64-84c8-7d0bef9a6de0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.575939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b811f-0c00-4b64-84c8-7d0bef9a6de0 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.577513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 416/851] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:29.586864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2503d7-1172-4980-8351-30f964c96ac7 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.587284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2503d7-1172-4980-8351-30f964c96ac7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.587912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2503d7-1172-4980-8351-30f964c96ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.611337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2c2503d7-1172-4980-8351-30f964c96ac7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:29.612589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2c2503d7-1172-4980-8351-30f964c96ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:29.635324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:29.640121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce8056-7c94-42e3-aef4-08e6255cb95f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:29.658324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:29.680257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:29.681185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.681476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.681757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.691116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:29.692785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:29.704412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 417/852] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:29 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:29.704412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2503d7-1172-4980-8351-30f964c96ac7 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:29.716778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:29.717771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:29.719322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 436/853] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:38:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:29.725779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.807485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2503d7-1172-4980-8351-30f964c96ac7 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:29.840175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dca6d0-2e0b-479e-a5bc-0d71a6fd9539 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:29.842498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:29.843167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.843455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.844420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.845079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:29.846469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:29.862329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 418/854] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:29 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:29.863174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.909667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:29.916908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:29.917357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:29.917615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:29.917870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:29.951350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:29.960061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:29.961891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:29.963552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 437/855] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:38:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:29.970002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:29.997451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:30.026758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a6649f-29aa-400f-97af-3e1d3e7b2a6e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.085859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.086559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.086851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.087134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.087997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:30.088315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.089817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.110775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 419/856] 10.222.0.20 () {56 vars in 1135 bytes} [Thu Jun 30 12:38:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:30.119053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:30.122029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aad2bc-d078-4263-91b2-2cc1d56fad4c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.165888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.166636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.166924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.167206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.168008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:30.168325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.169745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.184661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 438/857] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:38:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:30.186683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:30.242927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:30.269820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32554d2b-b4ce-4180-8bb3-12c44aee906b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.310728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:30.311656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6c6a4-2776-4b29-805c-d2050d9dd886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.312911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6c6a4-2776-4b29-805c-d2050d9dd886 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.313367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6c6a4-2776-4b29-805c-d2050d9dd886 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.313703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6c6a4-2776-4b29-805c-d2050d9dd886 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.339634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e448d9cf-8bee-4a45-8a62-90c985b9d75d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.379242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.380055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.380349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.380757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.388548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6c6a4-2776-4b29-805c-d2050d9dd886 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.390366 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f6c6a4-2776-4b29-805c-d2050d9dd886 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.394690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.396146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:30.415715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:30.416771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:30.418261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:30.418261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:30.418261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:30.418261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:30.418261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 439/858] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:30.424868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:30.499334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:30.511513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 420/859] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:30 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:38:30.513083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc41d-a4df-4b49-ac4b-7d1c1cb6a72b None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.513442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc41d-a4df-4b49-ac4b-7d1c1cb6a72b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.513926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98cc41d-a4df-4b49-ac4b-7d1c1cb6a72b None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.515304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 421/860] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:30.518059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cc41d-a4df-4b49-ac4b-7d1c1cb6a72b None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:30.563323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2885c80-e853-4865-bccd-10473dd032d0 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.602376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:30.616788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30994ea6-2812-4979-9501-263d61aa397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.617467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994ea6-2812-4979-9501-263d61aa397f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.617755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994ea6-2812-4979-9501-263d61aa397f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.618038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30994ea6-2812-4979-9501-263d61aa397f None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.618749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30994ea6-2812-4979-9501-263d61aa397f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:30.619481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30994ea6-2812-4979-9501-263d61aa397f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.620593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30994ea6-2812-4979-9501-263d61aa397f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.636235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 440/861] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:30.637626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94b3ae-84e3-4519-9281-486e3d683db0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.637913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94b3ae-84e3-4519-9281-486e3d683db0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.638187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94b3ae-84e3-4519-9281-486e3d683db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.657453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-db94b3ae-84e3-4519-9281-486e3d683db0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:30.658653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-db94b3ae-84e3-4519-9281-486e3d683db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:30.674056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98cc41d-a4df-4b49-ac4b-7d1c1cb6a72b None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.719886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.720729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.721023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.721282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.733274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.740811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 441/862] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:30 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:30.741016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.741114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94b3ae-84e3-4519-9281-486e3d683db0 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:30.765161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:30.766194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:30.768067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:30.768067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:30.768067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:30.768067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:30.768067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 422/863] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:30.768067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:30.818871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:30.857306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94b3ae-84e3-4519-9281-486e3d683db0 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.877864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:30.884799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fd605-c4ab-4691-9d72-6f8d670a3c55 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:30.897826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.898734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.899022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.899303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.907217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.916358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.931363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:30.932033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:30.932316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:30.932623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:30.933271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:30.934163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:30.935228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:30.935780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:30.935780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:30.940325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 442/864] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:38:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:30.941347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:30.953799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 423/865] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:30 2022] POST /identity/v3/services => generated 269 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:30.955010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:31.078310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00834ca-c4b1-475c-913f-e5bb82b5732f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:31.127240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:31.131856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:31.132573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:31.133075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:31.133455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:31.134536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:31.134853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:31.135689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b6c521-1873-4883-b539-e79e991decef None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:31.136462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:31.151714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 443/866] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:31.157866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:31.188610 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:31.189309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:31.189783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:31.190075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:31.191748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:31.192174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:31.194264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:31.207699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:31.220515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 424/867] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 30 12:38:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:31.223046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:31.285201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bafd1c-ef28-4074-b31b-84fce4bb08ec None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:31.323895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:31.325549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:31.325549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:31.325549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:31.333901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:31.335495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:31.339132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70154b18-0830-41d4-b1c5-5730fc38c3a1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:31.352209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:31.353550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:31.354458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 444/868] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:31.359047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:31.386781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:31.387856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:31.388346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:31.388873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:31.430613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:31.485299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:31.489828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:31.492077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:31.494465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be74d0d9-202e-49dd-9e63-737059de2364 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:31.542399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:31.543104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:31.543563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:31.543929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:31.545605 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:31.546030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:31.548874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:31.575715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 445/869] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:31.577505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:31.636504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 425/870] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:31 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 12:38:31.640716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:31.704061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5879af7-6fb7-402b-9bc3-356b7a48f768 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:31.725420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:31.752223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:31.753665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:31.754300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:31.754864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:31.755945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=addf74dd6b6f4f78bace4808bf676acc) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:31.756692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:31.759136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:31.769707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 446/871] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:31 2022] GET /identity/v3/role_assignments?user.id=addf74dd6b6f4f78bace4808bf676acc&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:31.797887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23bc23b-131a-4336-b772-11f6661329ac None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:31.843138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:31.844864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:31.845398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:31.845690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:31.858771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:31.861230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:31.881945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:31.882899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:31.883797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:31.883797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:31.883797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:31.883797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:31.888024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 426/872] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:31.889593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:31.919127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:32.043696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c7561b-6946-4226-b825-e7ec9f81ace8 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:32.084549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2d2355-d93b-4c26-99c7-66244cd7e180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:32.085244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2355-d93b-4c26-99c7-66244cd7e180 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.085534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2355-d93b-4c26-99c7-66244cd7e180 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.085818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2d2355-d93b-4c26-99c7-66244cd7e180 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.086567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d2355-d93b-4c26-99c7-66244cd7e180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:32.086884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d2355-d93b-4c26-99c7-66244cd7e180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:32.088299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2d2355-d93b-4c26-99c7-66244cd7e180 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:32.110432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 447/873] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:32.112085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:32.146162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3d70-3597-48b6-9378-530ae7663ef4 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.146550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3d70-3597-48b6-9378-530ae7663ef4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.146840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07a3d70-3597-48b6-9378-530ae7663ef4 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.149257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 448/874] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:32.155350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b5d8-ba94-449e-a4ed-937815b4e3c3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.155623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b5d8-ba94-449e-a4ed-937815b4e3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.155905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b5d8-ba94-449e-a4ed-937815b4e3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.173469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9d09b5d8-ba94-449e-a4ed-937815b4e3c3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:32.174690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9d09b5d8-ba94-449e-a4ed-937815b4e3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:32.233660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da2771-beb2-496c-8388-d7ec8c291c9a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:32.252340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 449/875] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:32 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:32.253633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:32.276525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b5d8-ba94-449e-a4ed-937815b4e3c3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:32.290978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:32.291791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.292073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.292348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.292877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:32.300252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:32.301825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:32.318159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:32.319198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:32.320084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 427/876] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:32.326256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:32.399591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b5d8-ba94-449e-a4ed-937815b4e3c3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:32.438962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9293349a-6977-4932-b615-f5676307ec8f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:32.440545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:32.441663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.442147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.442640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.443507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:32.445184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:32.459336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:32.460737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:32.461633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:32.464341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 450/877] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:32.470989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:32.485182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:32.486210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.486692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.487208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.488247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:32.488808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:32.490625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:32.505059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 428/878] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:32.510829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:32.542873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:32.575227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:32.619793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4113ddae-6a21-468c-abfb-97e002f2aba4 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:32.640324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d4bf6e-be5a-48c5-94bf-3f9e31b748a5 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:32.664112 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:32.668696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.669273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.669748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.670682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:32.671482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:32.674009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:32.686726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 451/879] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:32.688505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:32.695573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:32.697170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.697462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.697745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.698589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=8ffd5ef5211d42f8b7ba6000166d1a41) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:32.698907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:32.700355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:32.709750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 429/880] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:32 2022] GET /identity/v3/role_assignments?user.id=8ffd5ef5211d42f8b7ba6000166d1a41&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:32.830429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804261d9-8a7b-4979-bd11-43748893f720 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:32.871467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:32.872561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:32.873073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:32.873573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:32.874486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:32.875125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:32.876547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:32.879082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:32.883687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 452/881] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:32.889655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:33.004772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:33.018818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0479f62-e39a-49df-b1b7-37c7641eab24 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:33.057675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132c5c70-d59d-4acd-a316-822534ddf913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:33.058395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c5c70-d59d-4acd-a316-822534ddf913 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:33.058692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c5c70-d59d-4acd-a316-822534ddf913 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:33.058975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132c5c70-d59d-4acd-a316-822534ddf913 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:33.059780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c5c70-d59d-4acd-a316-822534ddf913 None admin] RBAC: Adding query filter params (interface=public, service_id=9b6532f66b9440ca8c23ff387d493bf7, region_id=RegionOne) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:33.060100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c5c70-d59d-4acd-a316-822534ddf913 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:33.061521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132c5c70-d59d-4acd-a316-822534ddf913 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:33.069279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 430/882] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:38:32 2022] GET /identity/v3/endpoints?service_id=9b6532f66b9440ca8c23ff387d493bf7&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:33.074739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:33.176936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da65b-e746-44c6-b667-12206e25f598 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:33.177476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da65b-e746-44c6-b667-12206e25f598 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:33.177476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2da65b-e746-44c6-b667-12206e25f598 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:33.179138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 431/883] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:33.184412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ed8b-d207-4bb0-a986-55402ecfc042 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:33.184723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ed8b-d207-4bb0-a986-55402ecfc042 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:33.185009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8ed8b-d207-4bb0-a986-55402ecfc042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:33.188135 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08c3b7-6aea-4ebf-a7cb-0d2dd3bff286 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:33.203188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a6f8ed8b-d207-4bb0-a986-55402ecfc042 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:33.205042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a6f8ed8b-d207-4bb0-a986-55402ecfc042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:33.225043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:33.225722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:33.226015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:33.226302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:33.227002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:33.228518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:33.235010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 453/884] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:38:33 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:38:33.287797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 432/885] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:33 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:33.322184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:33.395457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:33.439069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d87213-e5a3-4c1c-8628-71f2cc3671be None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:33.476553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:33.477381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:33.477667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:33.477949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:33.478611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:33.479981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:33.493311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:33.494306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:33.495143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 454/886] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jun 30 12:38:33 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:33.500549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ed8b-d207-4bb0-a986-55402ecfc042 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:33.590806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:33.607698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8ed8b-d207-4bb0-a986-55402ecfc042 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:33.649508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:33.650593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:33.651081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:33.651554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:33.652637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:33.653163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:33.654795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:33.661359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 433/887] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:33 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:33.666706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:33.784344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dec4c-e7cb-4d01-937f-39f62d22425a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:33.822264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:33.831326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:33.831996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:33.832279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:33.832594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:33.833496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:33.833868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:33.835427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:33.841305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 455/888] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:33 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:33.847812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:33.964559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c9670e-01f6-4925-85e3-5727aacd3009 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:34.006495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb250f9-997c-4ad3-ab52-98812a3444fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:34.007179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb250f9-997c-4ad3-ab52-98812a3444fc None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:34.007467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb250f9-997c-4ad3-ab52-98812a3444fc None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:34.007748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb250f9-997c-4ad3-ab52-98812a3444fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:34.008597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb250f9-997c-4ad3-ab52-98812a3444fc None admin] RBAC: Adding query filter params (interface=public, service_id=34e14c65dc954dfa90a536a73e3d4813, region_id=RegionOne) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:34.008916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb250f9-997c-4ad3-ab52-98812a3444fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:34.010342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb250f9-997c-4ad3-ab52-98812a3444fc None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:34.016898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 434/889] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:38:33 2022] GET /identity/v3/endpoints?service_id=34e14c65dc954dfa90a536a73e3d4813&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:34.022560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:34.138047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3125f-3923-4786-a6b8-5a750cb9f2dd None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:34.138346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3125f-3923-4786-a6b8-5a750cb9f2dd None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:34.138512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c3125f-3923-4786-a6b8-5a750cb9f2dd None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:34.140984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 435/890] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:34.146396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8d92a0-d0d4-4abd-a67c-2d773b5f7ebd None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:34.146756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28fa15-87a7-41ab-89c3-b46470c55b3d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:34.147009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28fa15-87a7-41ab-89c3-b46470c55b3d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:34.147227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da28fa15-87a7-41ab-89c3-b46470c55b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:34.165128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-da28fa15-87a7-41ab-89c3-b46470c55b3d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:34.166395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-da28fa15-87a7-41ab-89c3-b46470c55b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:34.178019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:34.210500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:34.211626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:34.212423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:34.212636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:34.213796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:34.216199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:34.228843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 456/891] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:38:34 2022] GET /identity/v3/services => generated 1268 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:38:34.256908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 436/892] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:34 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:34.282561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:34.350167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:34.402774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2903b-c0c1-4c6a-b1ba-9fdd62b3124e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:34.448487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:34.450101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:34.450668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:34.450954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:34.451618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:34.453559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:34.467125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:34.468253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:34.469449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 457/893] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:34.474695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28fa15-87a7-41ab-89c3-b46470c55b3d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:34.585992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da28fa15-87a7-41ab-89c3-b46470c55b3d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:34.628666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ece9033-1032-414b-a434-b63ac9d2ee83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:34.629348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece9033-1032-414b-a434-b63ac9d2ee83 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:34.629633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece9033-1032-414b-a434-b63ac9d2ee83 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:34.629915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ece9033-1032-414b-a434-b63ac9d2ee83 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:34.630636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece9033-1032-414b-a434-b63ac9d2ee83 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:34.630948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece9033-1032-414b-a434-b63ac9d2ee83 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:34.632334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ece9033-1032-414b-a434-b63ac9d2ee83 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:34.637888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 437/894] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:34 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:34.644038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:34.760713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444bd4a-7b58-47e4-8fe1-3635014633c2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:34.783028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:34.805506 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2dbcf-d39d-4377-b616-4cd0dc0e41eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:34.806180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2dbcf-d39d-4377-b616-4cd0dc0e41eb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:34.806466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2dbcf-d39d-4377-b616-4cd0dc0e41eb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:34.806744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2dbcf-d39d-4377-b616-4cd0dc0e41eb None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:34.807455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2dbcf-d39d-4377-b616-4cd0dc0e41eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:34.807763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2dbcf-d39d-4377-b616-4cd0dc0e41eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:34.809171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2dbcf-d39d-4377-b616-4cd0dc0e41eb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:34.814969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 458/895] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:34 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:35.138374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e52a2-e78e-476a-a4f0-a659547a5208 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.138782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e52a2-e78e-476a-a4f0-a659547a5208 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.138968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5e52a2-e78e-476a-a4f0-a659547a5208 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.140664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 438/896] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:35.146573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6bf2-236c-4888-b3d4-dcf47ba1f502 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.146873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6bf2-236c-4888-b3d4-dcf47ba1f502 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.147159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e6bf2-236c-4888-b3d4-dcf47ba1f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.165122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-933e6bf2-236c-4888-b3d4-dcf47ba1f502 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:35.166328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-933e6bf2-236c-4888-b3d4-dcf47ba1f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:35.239293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 459/897] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:35.263624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e52a2-e78e-476a-a4f0-a659547a5208 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:35.276352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:35.384306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5e52a2-e78e-476a-a4f0-a659547a5208 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:35.422821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae70ccbb-aa59-4018-aec4-19743d232497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:35.423570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70ccbb-aa59-4018-aec4-19743d232497 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.423861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70ccbb-aa59-4018-aec4-19743d232497 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.424144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae70ccbb-aa59-4018-aec4-19743d232497 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.435637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae70ccbb-aa59-4018-aec4-19743d232497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:35.441447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a783f42-69eb-495c-8454-7295090b0beb None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.441740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a783f42-69eb-495c-8454-7295090b0beb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.442078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a783f42-69eb-495c-8454-7295090b0beb None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.443700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 460/898] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-ae70ccbb-aa59-4018-aec4-19743d232497 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:35.444773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:35.446692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:35.447871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 439/899] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 30 12:38:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:35.451867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a783f42-69eb-495c-8454-7295090b0beb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:35.455093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223231f-9347-41d2-bea8-3e3872581223 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.455420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223231f-9347-41d2-bea8-3e3872581223 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.458088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3223231f-9347-41d2-bea8-3e3872581223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.475116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3223231f-9347-41d2-bea8-3e3872581223 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:35.476320 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3223231f-9347-41d2-bea8-3e3872581223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:35.555257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:35.563781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 440/900] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:35 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:35.581958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a783f42-69eb-495c-8454-7295090b0beb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:35.597914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:35.605228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223231f-9347-41d2-bea8-3e3872581223 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:35.632294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:35.633445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.633939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.634419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.635935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:35.636535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:35.639068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:35.662900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 461/901] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 30 12:38:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:35.674916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:35.737000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3223231f-9347-41d2-bea8-3e3872581223 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:35.776878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:35.778097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.778709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.779310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.780175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:35.781995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:35.795408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:35.797235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 30 12:38:35.798103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:35.805807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 441/902] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:35.807486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:35.818060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d2244-d07c-42cb-a717-47715e91ff1c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:35.856459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:35.857696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.858234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.858754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.872281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:35.874153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:35.888626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:35.895863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:35.896891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:35.897791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:35.897791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:35.897791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:35.897791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:35.904200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 462/903] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:35.905701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:35.939918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fa8e76-e2a3-4245-b988-62852df18c67 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:35.942685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:35.992819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:35.994599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:35.995033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:35.995421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:35.996258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:35.996693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:35.998189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.010136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 442/904] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:36.011679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.034891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71078516-cd0f-4947-a0c6-00d9e929a253 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:36.084165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:36.085046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.085447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.085843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.086773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:36.087162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:36.089456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.108421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 463/905] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:36.119470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.141548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d6e749-782d-4e03-a46d-7ed2712dd4e2 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:36.177851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:36.191037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:36.192563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.193155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.193620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.195201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:36.195702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:36.198763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.206619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 443/906] 10.222.0.20 () {56 vars in 1114 bytes} [Thu Jun 30 12:38:36 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:36.213387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.231412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:36.249260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155dd91-8e30-484a-9e1e-bc5bfd3d2d08 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:36.294285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:36.295641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.296111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.296798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.306213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:36.308509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:36.329176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:36.330388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:36.331560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:36.332698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5987d0f-f994-41e5-9525-9b5206b52a43 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:36.334379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 464/907] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:38:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:36.341457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.385836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb60d69-3add-4e1f-8bf7-155dd77f3cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:36.386659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb60d69-3add-4e1f-8bf7-155dd77f3cfd None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.387462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb60d69-3add-4e1f-8bf7-155dd77f3cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.387462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb60d69-3add-4e1f-8bf7-155dd77f3cfd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.388421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb60d69-3add-4e1f-8bf7-155dd77f3cfd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:36.390172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb60d69-3add-4e1f-8bf7-155dd77f3cfd None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.420468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 444/908] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:38:36 2022] POST /identity/v3/endpoints => generated 346 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:36.466434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fed26c-9e4c-4f56-a67d-cf43916c529a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:36.485396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d77d-da03-4bfd-aada-445e0d9fa240 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.486038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d77d-da03-4bfd-aada-445e0d9fa240 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.486545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660d77d-da03-4bfd-aada-445e0d9fa240 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.488570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 445/909] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:36.496025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70384cb-247d-46c7-bc93-af73ede891d4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.496735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70384cb-247d-46c7-bc93-af73ede891d4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.497244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70384cb-247d-46c7-bc93-af73ede891d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.516214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f70384cb-247d-46c7-bc93-af73ede891d4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:36.518232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f70384cb-247d-46c7-bc93-af73ede891d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:36.523931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:36.524660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.524953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.525236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.526119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:36.526436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:36.527950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.556138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 465/910] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 30 12:38:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:36.565882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.569088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:36.595038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:36.613255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 446/911] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:36 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:36.637495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70384cb-247d-46c7-bc93-af73ede891d4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.696177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70133fd1-5ae8-42a7-8948-a5bbd529dff7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:36.740917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:36.741735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.742586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.742931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.772922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70384cb-247d-46c7-bc93-af73ede891d4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:36.811957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:36.813394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:36.813754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:36.814108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:36.814910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:36.816584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.820442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:36.822157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:36.824341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:36.833074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:36.834059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 30 12:38:36.835024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:36.839644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 447/912] 10.222.0.20 () {56 vars in 1132 bytes} [Thu Jun 30 12:38:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:36.841338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.894394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:36.965640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 466/913] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:36 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:38:36.972831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:36.978825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77449ba-b797-47c5-bbea-59caed667176 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:37.024559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:37.025471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.026341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.026774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.027646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:37.028100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:37.030298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:37.037349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 448/914] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:37.045780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:37.100855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812d107-3c95-446d-a65b-aa6c8152379f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:37.102434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:37.138020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d98237-229d-42a1-b582-4e6b7972a3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:37.138818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d98237-229d-42a1-b582-4e6b7972a3a9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.139109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d98237-229d-42a1-b582-4e6b7972a3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.139392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d98237-229d-42a1-b582-4e6b7972a3a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.151215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d98237-229d-42a1-b582-4e6b7972a3a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:37.152708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d98237-229d-42a1-b582-4e6b7972a3a9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:37.164776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb6416-91b3-4a74-ba4f-2949233fa2cf None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:37.167944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-77d98237-229d-42a1-b582-4e6b7972a3a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:37.172413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:37.173300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:37.174209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:37.174209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:37.174209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:37.174209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:37.174209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 467/915] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:37.175328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d2c70-5543-4a37-b6d2-ee60dd9b75cb None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.175602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d2c70-5543-4a37-b6d2-ee60dd9b75cb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.175883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4d2c70-5543-4a37-b6d2-ee60dd9b75cb None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.177314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 468/916] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:37.181836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d2c70-5543-4a37-b6d2-ee60dd9b75cb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:37.210146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a65231-4175-4250-bec8-80faae21451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:37.210822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a65231-4175-4250-bec8-80faae21451e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.211115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a65231-4175-4250-bec8-80faae21451e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.211403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a65231-4175-4250-bec8-80faae21451e None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.212146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a65231-4175-4250-bec8-80faae21451e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:37.212465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a65231-4175-4250-bec8-80faae21451e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:37.213859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a65231-4175-4250-bec8-80faae21451e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:37.223671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 449/917] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:37.225197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da431419-9d78-4156-bcfd-2eb152a3849d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.225467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da431419-9d78-4156-bcfd-2eb152a3849d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.225753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da431419-9d78-4156-bcfd-2eb152a3849d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.244949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-da431419-9d78-4156-bcfd-2eb152a3849d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:37.246225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-da431419-9d78-4156-bcfd-2eb152a3849d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:37.303155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4d2c70-5543-4a37-b6d2-ee60dd9b75cb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:37.323641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 450/918] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:37.324187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da431419-9d78-4156-bcfd-2eb152a3849d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:37.348200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:37.348937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.349223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.349501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.350303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:37.350556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:37.351898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:37.381939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 469/919] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:37.381939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:37.409716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:37.492820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:37.500215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da431419-9d78-4156-bcfd-2eb152a3849d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:37.532940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6883aa27-7f2b-43f3-8b1b-1ebcce2e4f3a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:37.567475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:37.568705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.569301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.569803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] PATH_INFO: `/v3/endpoints` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.571578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:37.573861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:37.576898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:37.577575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.577929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.578880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.579880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:37.581744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:37.602016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 470/920] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:37 2022] POST /identity/v3/services => generated 241 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:37.602884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:37.606551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 451/921] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:38:37 2022] POST /identity/v3/endpoints => generated 347 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:37.777907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:37.835815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c18d7-e36c-4de3-8d72-99b8cbdab012 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:37.897593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:37.898947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:37.899444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:37.899929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:37.913570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:37.916267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:37.945424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:37.947168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:37.949103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 471/922] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:37.957708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:38.160501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efeafc-7972-43f2-867d-710ed8be06ea None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:38.222443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458363ef-d1db-47e6-a0df-651f0d88237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:38.223123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458363ef-d1db-47e6-a0df-651f0d88237d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:38.223415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458363ef-d1db-47e6-a0df-651f0d88237d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:38.223693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458363ef-d1db-47e6-a0df-651f0d88237d None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:38.224539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458363ef-d1db-47e6-a0df-651f0d88237d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:38.224859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458363ef-d1db-47e6-a0df-651f0d88237d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:38.226327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458363ef-d1db-47e6-a0df-651f0d88237d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:38.242062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 452/923] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:38.251731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:38.450095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9ccc3b-6efe-4d25-bd0e-580fc3c26119 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:38.504931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:38.513700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb99ca-c3f7-4692-9ac9-b943d0e9176e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:38.514852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb99ca-c3f7-4692-9ac9-b943d0e9176e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:38.516152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb99ca-c3f7-4692-9ac9-b943d0e9176e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:38.516989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb99ca-c3f7-4692-9ac9-b943d0e9176e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:38.519241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb99ca-c3f7-4692-9ac9-b943d0e9176e None admin] RBAC: Adding query filter params (role.id=f64b40787f2d46b488f5c4a5e53cce06, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=8ffd5ef5211d42f8b7ba6000166d1a41) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:38.520306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb99ca-c3f7-4692-9ac9-b943d0e9176e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:38.523052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb99ca-c3f7-4692-9ac9-b943d0e9176e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:38.535529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 472/924] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:38 2022] GET /identity/v3/role_assignments?user.id=8ffd5ef5211d42f8b7ba6000166d1a41&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=f64b40787f2d46b488f5c4a5e53cce06 => generated 259 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:39.321922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460733-96ec-44ec-93c8-74d71af56e9e None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:39.322697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460733-96ec-44ec-93c8-74d71af56e9e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:39.322697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f460733-96ec-44ec-93c8-74d71af56e9e None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:39.324148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 453/925] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:39.331582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff6e-6dad-426d-9538-74ff027edd35 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:39.331908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff6e-6dad-426d-9538-74ff027edd35 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:39.332146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3ff6e-6dad-426d-9538-74ff027edd35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:39.351187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-def3ff6e-6dad-426d-9538-74ff027edd35 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:39.352406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-def3ff6e-6dad-426d-9538-74ff027edd35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:39.493942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 473/926] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:39 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:39.518961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460733-96ec-44ec-93c8-74d71af56e9e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:39.536853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:39.641594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f460733-96ec-44ec-93c8-74d71af56e9e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:39.685362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:39.686053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:39.686340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:39.686625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:39.687455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:39.689383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:39.695022 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING keystone.server.flask.common [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 30 12:38:39.713096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.sql.core [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 12:38:39.713096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 12:38:39.713096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [parameters: {'id': 'dd79440ef31d475cb371dfcf3236e0ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 12:38:39.713096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80103) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd79440ef31d475cb371dfcf3236e0ec.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd79440ef31d475cb371dfcf3236e0ec. Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application conn.query(q) Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 12:38:39.721678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result.read() Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 30 12:38:39.723232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application next(self.gen) Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application yield resource Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application next(self.gen) Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise self.value Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application session.commit() Jun 30 12:38:39.725645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.session.flush() Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application compat.raise_( Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 12:38:39.727409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 12:38:39.731596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application conn.query(q) Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result.read() Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 12:38:39.740234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [parameters: {'id': 'dd79440ef31d475cb371dfcf3236e0ec', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:39.743322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:39.746536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id dd79440ef31d475cb371dfcf3236e0ec. Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:39.750037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 454/927] 10.222.0.20 () {60 vars in 1140 bytes} [Thu Jun 30 12:38:39 2022] POST /identity/v3/projects => generated 262 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:39.753554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ff6e-6dad-426d-9538-74ff027edd35 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:39.944140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3ff6e-6dad-426d-9538-74ff027edd35 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:39.996935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:40.010209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255c3e5-1d5a-4a5a-b870-4121c8395bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:40.012141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c3e5-1d5a-4a5a-b870-4121c8395bdb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.012946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c3e5-1d5a-4a5a-b870-4121c8395bdb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.013915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255c3e5-1d5a-4a5a-b870-4121c8395bdb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.027685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255c3e5-1d5a-4a5a-b870-4121c8395bdb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:40.030380 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255c3e5-1d5a-4a5a-b870-4121c8395bdb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-9255c3e5-1d5a-4a5a-b870-4121c8395bdb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:40.058307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:40.060031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:40.062905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 474/928] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:40.074118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:40.136243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2b7e-40bb-4f5d-9899-da9583d7c721 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.136742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2b7e-40bb-4f5d-9899-da9583d7c721 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.137241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f2b7e-40bb-4f5d-9899-da9583d7c721 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.140646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 475/929] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:40.149280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b4b2-a35f-4843-90ab-1a2a20636920 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.149752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b4b2-a35f-4843-90ab-1a2a20636920 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.150229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed1b4b2-a35f-4843-90ab-1a2a20636920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.154752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:40.180062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1ed1b4b2-a35f-4843-90ab-1a2a20636920 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:40.182643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1ed1b4b2-a35f-4843-90ab-1a2a20636920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:40.197576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad07cf3-aff3-400c-b696-44cdf00fbc76 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:40.237554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:40.238576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.239116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.239537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.240542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:40.241401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:40.243549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:40.276579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 455/930] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:40 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:40.315723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 476/931] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:40.355178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:40.491622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d368e02-416d-401d-9d73-40ce0372c1d4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:40.526046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:40.533218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09a9115-4fa1-42dd-9382-dea1d83edc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:40.534825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a9115-4fa1-42dd-9382-dea1d83edc34 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.535111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a9115-4fa1-42dd-9382-dea1d83edc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.535745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09a9115-4fa1-42dd-9382-dea1d83edc34 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.536456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a9115-4fa1-42dd-9382-dea1d83edc34 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:40.537887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09a9115-4fa1-42dd-9382-dea1d83edc34 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-e09a9115-4fa1-42dd-9382-dea1d83edc34 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:40.551591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:40.553564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:40.555205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 456/932] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:40.564970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b4b2-a35f-4843-90ab-1a2a20636920 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:40.647873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b363bb1-aa41-43b3-9670-2dcd960451cc None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.648335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b363bb1-aa41-43b3-9670-2dcd960451cc None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.648835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b363bb1-aa41-43b3-9670-2dcd960451cc None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.652499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 457/933] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:40.660483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb57d-8eb2-413b-be16-dfe6785847df None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.660778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb57d-8eb2-413b-be16-dfe6785847df None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.661053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5cb57d-8eb2-413b-be16-dfe6785847df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.679706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7b5cb57d-8eb2-413b-be16-dfe6785847df None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:40.681375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7b5cb57d-8eb2-413b-be16-dfe6785847df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:40.775221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed1b4b2-a35f-4843-90ab-1a2a20636920 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:40.792905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:40.802323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 458/934] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:40 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:40.825643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:40.826600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:40.827036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:40.827464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:40.828910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:40.829422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:40.830960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:40.837110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 477/935] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:40 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:40.843114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cb57d-8eb2-413b-be16-dfe6785847df None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:40.849104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:40.973668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091be0b-5189-41ea-ae83-5c959c373c7a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:41.019188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:41.020263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:41.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:41.021176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:41.022493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:41.024085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:41.039637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:41.040716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:41.041545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:41.045951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 478/936] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:40 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:41.059065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:41.069108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5cb57d-8eb2-413b-be16-dfe6785847df None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:41.096848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:41.110516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:41.111672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:41.112141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:41.112632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:41.113538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:41.114056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:41.115685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:41.127605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 459/937] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:41.128961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:41.148748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:41.262669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08116a74-e6c9-40ee-a4bf-fcd633b1f1ab None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:41.273086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2026cc56-e051-427f-bb19-e0a643a74d96 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:41.308328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:41.309358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:41.310789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:41.311570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:41.314936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:41.316935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:41.318347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:41.332339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 479/938] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:41.338435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:41.346958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:41.348100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:41.348658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:41.349160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:41.350803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] RBAC: Adding query filter params (interface=public, service_id=8466b2c6a14e4ffa844ebb0cf9c84b73, region_id=RegionOne) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:41.351377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:41.354219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:41.366231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 460/939] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:38:41 2022] GET /identity/v3/endpoints?service_id=8466b2c6a14e4ffa844ebb0cf9c84b73&interface=public®ion_id=RegionOne => generated 194 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:41.374076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:41.448909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:41.494049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be276f80-4166-430a-b985-7cb08fcf5716 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:41.495741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:41.513584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5f88e6-6f40-4660-92d2-357f337609a3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:41.533795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532147e9-d950-4cc2-8339-eca7d328ee18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:41.534478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532147e9-d950-4cc2-8339-eca7d328ee18 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:41.534764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532147e9-d950-4cc2-8339-eca7d328ee18 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:41.535042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532147e9-d950-4cc2-8339-eca7d328ee18 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:41.535824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532147e9-d950-4cc2-8339-eca7d328ee18 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:41.536068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532147e9-d950-4cc2-8339-eca7d328ee18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:41.537546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532147e9-d950-4cc2-8339-eca7d328ee18 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:41.548421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 480/940] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:41 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:41.563192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aecae2b-ee73-4552-acee-05e5dcd1feb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:41.563695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecae2b-ee73-4552-acee-05e5dcd1feb1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:41.563984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecae2b-ee73-4552-acee-05e5dcd1feb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:41.564327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aecae2b-ee73-4552-acee-05e5dcd1feb1 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:41.565081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecae2b-ee73-4552-acee-05e5dcd1feb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:41.566731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aecae2b-ee73-4552-acee-05e5dcd1feb1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:41.574301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 461/941] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:38:41 2022] GET /identity/v3/services => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:38:42.024168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259968-1cce-4911-920e-5f1b857ba500 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:42.024752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259968-1cce-4911-920e-5f1b857ba500 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:42.025220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8259968-1cce-4911-920e-5f1b857ba500 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:42.028225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 481/942] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:42.039922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef9f2-36d7-4b5e-9d43-3a05f75c0c80 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:42.040513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef9f2-36d7-4b5e-9d43-3a05f75c0c80 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:42.041015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ef9f2-36d7-4b5e-9d43-3a05f75c0c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:42.096605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-180ef9f2-36d7-4b5e-9d43-3a05f75c0c80 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:42.099257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-180ef9f2-36d7-4b5e-9d43-3a05f75c0c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:42.244769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 462/943] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:42.287252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8259968-1cce-4911-920e-5f1b857ba500 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:42.514663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8259968-1cce-4911-920e-5f1b857ba500 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:42.578838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:42.580131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:42.580673 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:42.581177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:42.603483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:42.620853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:42.622684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:42.624308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:42.632426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 482/944] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 30 12:38:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:42.633455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef9f2-36d7-4b5e-9d43-3a05f75c0c80 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:42.712156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:42.772089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ef9f2-36d7-4b5e-9d43-3a05f75c0c80 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:42.812874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be07eabe-2320-47aa-98aa-f1c3ff40ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:42.813540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07eabe-2320-47aa-98aa-f1c3ff40ec3b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:42.813826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07eabe-2320-47aa-98aa-f1c3ff40ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:42.814110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be07eabe-2320-47aa-98aa-f1c3ff40ec3b None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:42.814898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07eabe-2320-47aa-98aa-f1c3ff40ec3b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:42.815217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07eabe-2320-47aa-98aa-f1c3ff40ec3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:42.816671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be07eabe-2320-47aa-98aa-f1c3ff40ec3b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:42.830615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 463/945] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 30 12:38:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:42.832651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:42.865823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:42.966895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2770c69-5509-4f7e-8d6c-d328e415d1e1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.006961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.007768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.008052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.008329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.020491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.022024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:43.042213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:43.043916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:43.044931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:43.044931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:43.044931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:43.044931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:43.044931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 483/946] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:43.046050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7f93-898c-4c85-a5c5-27cbf6b97c56 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.046706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7f93-898c-4c85-a5c5-27cbf6b97c56 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.047209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1a7f93-898c-4c85-a5c5-27cbf6b97c56 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.048975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 464/947] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:43.050210 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:43.054943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cfa2-69eb-490a-bec2-87f50c39899d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.055234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cfa2-69eb-490a-bec2-87f50c39899d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.055528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57cfa2-69eb-490a-bec2-87f50c39899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.073712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0d57cfa2-69eb-490a-bec2-87f50c39899d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:43.074935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0d57cfa2-69eb-490a-bec2-87f50c39899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:43.141115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:43.156528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 465/948] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:43.164743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220b55d-baee-4b37-ac4f-6cd106856d89 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.176670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57cfa2-69eb-490a-bec2-87f50c39899d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:43.204999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.206161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.206709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.207209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.208174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:43.208950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.210658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.220005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:43.228917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 484/949] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:43.237586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:43.317803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57cfa2-69eb-490a-bec2-87f50c39899d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.362821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.363551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.363932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.364212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.365063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.366857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.383685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.sql.core [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 12:38:43.383685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 12:38:43.383685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [parameters: {'user_id': '3163ad05b7f844f9bf52cd6c7f55f5c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 12:38:43.383685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80103) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application conn.query(q) Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result.read() Jun 30 12:38:43.393276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 12:38:43.394734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application next(self.gen) Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application yield resource Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application next(self.gen) Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.session.rollback() Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.force_reraise() Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise self.value Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application session.commit() Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 30 12:38:43.396319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._prepare_impl() Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.session.flush() Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._flush(objects) Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application compat.raise_( Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application flush_context.execute() Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rec.execute(self) Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 30 12:38:43.397600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 30 12:38:43.398592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result = self._query(query) Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application conn.query(q) Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application result.read() Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 30 12:38:43.400747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [parameters: {'user_id': '3163ad05b7f844f9bf52cd6c7f55f5c4', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:43.402217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 30 12:38:43.403216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 466/950] 10.222.0.20 () {60 vars in 1131 bytes} [Thu Jun 30 12:38:43 2022] POST /identity/v3/users => generated 160 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:43.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:43.412075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631219f6-104f-4497-9bfc-c3cddbccfa43 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.471440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.472957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.473580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.474194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.485886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.488246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.491404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:43.521601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:43.523907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:43.525177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:43.526781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:43.527421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f973ea57-7029-4eb0-b69f-8cec4299fc9f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.536230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 485/951] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:38:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:43.538671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:43.564925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.565793 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.566082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.566360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.574712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.576498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:43.594132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:43.595207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 30 12:38:43.596991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:43.600355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 467/952] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:38:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:43.601508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:43.668625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0350d6e9-c05a-44a9-b787-a232b480f928 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.709699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.710745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.711331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.711931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.713026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:43.713555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.715438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.718661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b850fd3-2c50-46c4-83a7-56565ba41501 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.742333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 486/953] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 30 12:38:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:43.744106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:43.758825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.759613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.759797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.760068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.760979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:43.761296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.763000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.816759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 468/954] 10.222.0.20 () {56 vars in 1101 bytes} [Thu Jun 30 12:38:43 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:43.823342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:43.879850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032ef3bd-7974-45a0-8815-e9c7588deb17 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:43.922344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dbc9fc-471a-47b4-a498-d707e9b84917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:43.923067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbc9fc-471a-47b4-a498-d707e9b84917 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:43.923360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbc9fc-471a-47b4-a498-d707e9b84917 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:43.923646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dbc9fc-471a-47b4-a498-d707e9b84917 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:43.936037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbc9fc-471a-47b4-a498-d707e9b84917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:43.937615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dbc9fc-471a-47b4-a498-d707e9b84917 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-67dbc9fc-471a-47b4-a498-d707e9b84917 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:43.957960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:43.959435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:43.960328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:43.960328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:43.960328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:43.960328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:43.964123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 487/955] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:43.970623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.008855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:44.013340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880d89e-dcfb-40d6-b64b-3a78ed800556 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.013930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880d89e-dcfb-40d6-b64b-3a78ed800556 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.015760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9880d89e-dcfb-40d6-b64b-3a78ed800556 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.018000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 488/956] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:44.020630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342a7d-906d-42b7-b1b6-861a8cc76f88 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.020925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342a7d-906d-42b7-b1b6-861a8cc76f88 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.021204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4342a7d-906d-42b7-b1b6-861a8cc76f88 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.022618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 489/957] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:44.024441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f8b9-9613-4096-ad7b-977bde5c45a9 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.024986 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f8b9-9613-4096-ad7b-977bde5c45a9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.025451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613f8b9-9613-4096-ad7b-977bde5c45a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.049285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1613f8b9-9613-4096-ad7b-977bde5c45a9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:44.050668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1613f8b9-9613-4096-ad7b-977bde5c45a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:44.136544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 490/958] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:44.137941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e7bd-a7af-4ec8-88b6-c593fd008716 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.138233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e7bd-a7af-4ec8-88b6-c593fd008716 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.138515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7e7bd-a7af-4ec8-88b6-c593fd008716 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.144217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064074e3-9e74-41d6-8e20-dd397b430e86 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:44.161645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-01a7e7bd-a7af-4ec8-88b6-c593fd008716 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:44.162969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-01a7e7bd-a7af-4ec8-88b6-c593fd008716 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:44.185315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:44.185895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.186179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.186459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.187771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:44.188079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:44.189542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:44.202385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 469/959] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:44.204510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.215394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:44.261428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 491/960] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:44.262703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7e7bd-a7af-4ec8-88b6-c593fd008716 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.349567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:44.378091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3c4f2-f50f-440a-a345-8cc2ef97c48e None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:44.386816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7e7bd-a7af-4ec8-88b6-c593fd008716 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:44.431780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:44.432631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.432925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.433203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.436518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:44.437958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.437958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.437958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.439121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:44.440455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:44.441969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:44.443443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:44.455087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:44.457134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:44.458917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 470/961] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:44.460239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:44.465288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:44.466428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:44.467496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:44.470454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 492/962] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:44.472354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.509299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:44.590910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ead9b7-dcdb-47c1-8c5d-8a064a9170a3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:44.602468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d999-6606-49c5-b2c2-1faf524141f7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:44.633734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:44.634559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.634845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.635201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.636230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:44.637678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:44.652572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:44.653299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.653604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.653976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.654077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 471/963] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:44 2022] POST /identity/v3/services => generated 242 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:44.655375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.655494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:44.656716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:44.659152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:44.659323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:44.678890 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 493/964] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:44.685821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.845240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:44.858258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee796142-065d-45af-891b-15bd24f2ce38 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:44.865635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903fd517-3fe2-45ba-a9b2-04b0a03176fc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:44.912338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:44.913432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.913857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.914274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.915481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:44.915930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:44.917811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:44.927976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:44.929358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:44.930046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:44.930542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:44.931916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:44.932523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:44.934752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 472/965] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:44.935225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:44.941267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:44.945737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 494/966] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:44.951764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:45.025563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:45.091137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a70f889-3418-4650-b1f7-cc8513b2c682 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:45.102937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e33f7e-13a6-4e08-94b4-f6374588b015 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:45.140680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105403f-4006-4f29-9f23-f59701364855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:45.141782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105403f-4006-4f29-9f23-f59701364855 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:45.142541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105403f-4006-4f29-9f23-f59701364855 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:45.143042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105403f-4006-4f29-9f23-f59701364855 None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/8ffd5ef5211d42f8b7ba6000166d1a41/roles/f64b40787f2d46b488f5c4a5e53cce06` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:45.146309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105403f-4006-4f29-9f23-f59701364855 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=8ffd5ef5211d42f8b7ba6000166d1a41, role_id=f64b40787f2d46b488f5c4a5e53cce06)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:45.148261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105403f-4006-4f29-9f23-f59701364855 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:45.170165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 473/967] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:38:44 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/8ffd5ef5211d42f8b7ba6000166d1a41/roles/f64b40787f2d46b488f5c4a5e53cce06 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:38:45.180627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6413ecbe-cee3-4b6a-a8f6-ddb51d2a303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:45.180627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413ecbe-cee3-4b6a-a8f6-ddb51d2a303e None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:45.180627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413ecbe-cee3-4b6a-a8f6-ddb51d2a303e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:45.180627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6413ecbe-cee3-4b6a-a8f6-ddb51d2a303e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:45.181262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413ecbe-cee3-4b6a-a8f6-ddb51d2a303e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:45.184094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6413ecbe-cee3-4b6a-a8f6-ddb51d2a303e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:45.221618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 495/968] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:38:44 2022] POST /identity/v3/endpoints => generated 349 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:38:46.865139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca709e-a6f7-4a8c-8c88-5c721c48bc68 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:46.865664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca709e-a6f7-4a8c-8c88-5c721c48bc68 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:46.866148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca709e-a6f7-4a8c-8c88-5c721c48bc68 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:46.868932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 474/969] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:46.875489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6200ff-f25c-491d-86be-d229b0684cb2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:46.876142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6200ff-f25c-491d-86be-d229b0684cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:46.876142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6200ff-f25c-491d-86be-d229b0684cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:46.895333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bb6200ff-f25c-491d-86be-d229b0684cb2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:46.896630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bb6200ff-f25c-491d-86be-d229b0684cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:46.906542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:46.994227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 496/970] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:46 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:47.019054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca709e-a6f7-4a8c-8c88-5c721c48bc68 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:47.218570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ca709e-a6f7-4a8c-8c88-5c721c48bc68 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:47.258811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:47.296226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d9bd3e-7d51-4eb3-9dd7-3bb804806094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:47.297702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9bd3e-7d51-4eb3-9dd7-3bb804806094 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.298200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9bd3e-7d51-4eb3-9dd7-3bb804806094 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.298687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d9bd3e-7d51-4eb3-9dd7-3bb804806094 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.299927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9bd3e-7d51-4eb3-9dd7-3bb804806094 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:47.302596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d9bd3e-7d51-4eb3-9dd7-3bb804806094 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a6d9bd3e-7d51-4eb3-9dd7-3bb804806094 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:47.327791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:47.329105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:47.329964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:47.336123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 475/971] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:47 2022] GET /identity/v3/services/compute => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:47.339026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6200ff-f25c-491d-86be-d229b0684cb2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:47.378321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e470ca1-e62e-4ce8-9f01-eb36a0d0e3e2 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.378843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e470ca1-e62e-4ce8-9f01-eb36a0d0e3e2 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.379540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e470ca1-e62e-4ce8-9f01-eb36a0d0e3e2 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.382551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 476/972] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:47.391511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520a24-6b35-4152-8138-d8b23197f6a1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.392006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520a24-6b35-4152-8138-d8b23197f6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.392923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd520a24-6b35-4152-8138-d8b23197f6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.417919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-fd520a24-6b35-4152-8138-d8b23197f6a1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:47.420789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fd520a24-6b35-4152-8138-d8b23197f6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:47.478196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6200ff-f25c-491d-86be-d229b0684cb2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:47.536433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:47.537473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.537998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.538404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.539588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:47.540081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:47.542751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:47.553377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 497/973] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:47 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:47.555878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 477/974] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:47.563627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:47.568473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:47.584227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa18b3-8222-446c-b78b-8aba9f4ee36a None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.584582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa18b3-8222-446c-b78b-8aba9f4ee36a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.584853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa18b3-8222-446c-b78b-8aba9f4ee36a None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.586584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 478/975] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:47.592720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22296d3a-af0d-46e1-8145-fed69d584de1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.594456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22296d3a-af0d-46e1-8145-fed69d584de1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.594456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22296d3a-af0d-46e1-8145-fed69d584de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.620421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-22296d3a-af0d-46e1-8145-fed69d584de1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:47.622284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-22296d3a-af0d-46e1-8145-fed69d584de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:47.725536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 479/976] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:47 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:47.726986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22296d3a-af0d-46e1-8145-fed69d584de1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:47.747685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65dfc40-af37-4985-822a-89d28d31c1bf None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:47.801028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:47.821969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:47.823039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.823514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.823998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.825763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:47.826928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:47.830171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:47.838274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 498/977] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:47.839768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:47.876637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22296d3a-af0d-46e1-8145-fed69d584de1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:47.922643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:47.924015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:47.924570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:47.925025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:47.928574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:47.946127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:47.962907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:47.965077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:47.967144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 480/978] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 30 12:38:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:47.969330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:47.979147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe41f326-16a4-4680-b12c-ffdee7754a37 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.026342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.027168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.027457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.027739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.028439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.029862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:48.044183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:48.046581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:48.048306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 499/979] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:48.049463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:48.117980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84976c3c-41a6-40b1-b220-60769176cb78 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.120068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:48.167533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.168512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.168911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.169287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.170311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] RBAC: Adding query filter params (interface=public, service_id=b0952ae696324187870db8bf8a2afb4b, region_id=RegionOne) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:48.170847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.172630 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.179194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 481/980] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:38:47 2022] GET /identity/v3/endpoints?service_id=b0952ae696324187870db8bf8a2afb4b&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:48.179872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:48.203767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5dcdb4-fbf2-4b57-9a68-76162980b710 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.240239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:48.251107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.251797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.252188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.252340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.253151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:48.253468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.254911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.264494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 500/981] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:48.266130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:48.321120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1c85d1-c1dc-470c-9e50-c8c246cff227 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.367421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.368375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.368801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.369214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.370128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:48.370601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.372570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.380733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 482/982] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:48.382350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:48.414156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f818a-c3bd-484d-8a53-98c3e2d38987 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.428275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:48.476613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.477884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.478425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.478880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.480159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.482980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.503266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 501/983] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/services => generated 1727 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:38:48.503266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:48.537459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc43d9dd-6897-4379-8ed9-e6e950492018 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.602723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.604426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.604880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.605647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.611000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:48.630069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.632637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:48.668516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:48.669563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:48.670482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:48.670482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:48.670482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:48.670482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:48.679897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 483/984] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:48.681601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:48.688076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160b965-5b65-4d60-9db9-6204801b23af None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.759644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.760748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.761183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.761595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.762869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:48.763456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.766162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.775174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 502/985] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:48.782317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:48.847443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:48.882596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9899b0-3b0a-4dc6-bf59-03afa349e6d1 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.945464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:48.946520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:48.946987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:48.947394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:48.948655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:48.949176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:48.951459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:48.965968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b4c0a-4a44-4de8-8e2f-bd377cd65fc9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:48.977469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 484/986] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:48.979197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:49.002515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:49.028053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:49.028925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:49.029362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:49.029783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:49.031467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] RBAC: Adding query filter params (interface=admin, service_id=8466b2c6a14e4ffa844ebb0cf9c84b73, region_id=RegionOne) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:49.032148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:49.034143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:49.041213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 503/987] 10.222.0.20 () {56 vars in 1249 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/endpoints?service_id=8466b2c6a14e4ffa844ebb0cf9c84b73&interface=admin®ion_id=RegionOne => generated 193 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:49.048049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:49.158643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038ae91-9d52-4c12-bce6-28a191e73c36 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:49.203121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c755470b-2a2f-41d0-8add-577cb1a9d92a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:49.206730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:49.208421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:49.209057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:49.209057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:49.225381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:49.228236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:49.257992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:49.259838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:49.262094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 485/988] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:38:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:49.273345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:49.278243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:49.278650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:49.279507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:49.279924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:49.280499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:49.281539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:49.283198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:49.301094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 504/989] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:38:49 2022] GET /identity/v3/services => generated 1727 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:38:49.496599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c69676-92b4-4a1d-8127-8c9670d5dcde None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:49.565596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:49.566730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:49.567183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:49.567545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:49.569183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:49.569725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:49.572202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:49.610481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 486/990] 10.222.0.20 () {56 vars in 1149 bytes} [Thu Jun 30 12:38:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:49.612588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:49.683655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:49.773736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c60a11c-b90f-43dd-bdab-3ce32f1f87e4 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:49.819313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:49.819995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:49.820281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:49.820591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:49.908825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:49.910311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:49.975582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:50.074210 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 505/991] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:49 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:38:50.084638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:50.200142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:50.288962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f2b71f-47fa-4557-89bb-23d64ff0c7f7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:50.356077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:50.357391 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:50.357884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:50.358388 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:50.380874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:50.383554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:50.421413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:50.423068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:50.426045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:50.426045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:50.426045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:50.426045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:50.428677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 487/992] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:50.432783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:50.580042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d1f270-081c-4b7f-8a92-00e40044a35b None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:50.623823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:50.625017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:50.625445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:50.625586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:50.626327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:50.626644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:50.628146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:50.642963 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 506/993] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:50.649612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:50.799336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbdddc-187b-4577-93fb-607e7ec3400a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:50.817133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:50.861100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a50758d-9640-4b94-a0d9-13fe6faea174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:50.862826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50758d-9640-4b94-a0d9-13fe6faea174 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:50.863508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50758d-9640-4b94-a0d9-13fe6faea174 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:50.864212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a50758d-9640-4b94-a0d9-13fe6faea174 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:50.878700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50758d-9640-4b94-a0d9-13fe6faea174 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:50.881608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a50758d-9640-4b94-a0d9-13fe6faea174 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2a50758d-9640-4b94-a0d9-13fe6faea174 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:50.910021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:50.911130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:50.912167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:50.914911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 488/994] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:50.926091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:50.948627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:51.015268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283cda-28ba-418a-8e68-7638df71d2c3 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.015867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283cda-28ba-418a-8e68-7638df71d2c3 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.017177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3283cda-28ba-418a-8e68-7638df71d2c3 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.020732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 489/995] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:51.026631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85f551-fb51-4812-9a77-1dea1e80a473 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.026924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85f551-fb51-4812-9a77-1dea1e80a473 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.027929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f85f551-fb51-4812-9a77-1dea1e80a473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.048618 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1f85f551-fb51-4812-9a77-1dea1e80a473 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:51.049876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1f85f551-fb51-4812-9a77-1dea1e80a473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:51.120345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee42f2a-7b77-4d46-a49d-63b54616ba3f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:51.173001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 490/996] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:51.174049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:51.174697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.174977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.175261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.176073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:51.176411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:51.177927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:51.194667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 507/997] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:51.200778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85f551-fb51-4812-9a77-1dea1e80a473 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:51.214884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:51.320990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:51.382540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc648cd-06a3-4f29-bb1a-34e97d714a7f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:51.393672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f85f551-fb51-4812-9a77-1dea1e80a473 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:51.396877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:51.442784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:51.444590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.445083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.445584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.446824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:51.449529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:51.452884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:51.454429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.454873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.455345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.456221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] RBAC: Adding query filter params (role.id=f64b40787f2d46b488f5c4a5e53cce06, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=8ffd5ef5211d42f8b7ba6000166d1a41) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:51.456576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:51.458049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:51.465543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 491/998] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:51 2022] GET /identity/v3/role_assignments?user.id=8ffd5ef5211d42f8b7ba6000166d1a41&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=f64b40787f2d46b488f5c4a5e53cce06 => generated 608 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:51.475409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:51.477565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 30 12:38:51.479069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:51.485034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 508/999] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:51.488870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:51.708376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403501d-2210-4e2b-9146-648dd41d553c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:51.761856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc223015-c1ac-492e-a81c-b9a0d5013330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:51.762547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc223015-c1ac-492e-a81c-b9a0d5013330 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.762839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc223015-c1ac-492e-a81c-b9a0d5013330 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.763142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc223015-c1ac-492e-a81c-b9a0d5013330 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.763866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc223015-c1ac-492e-a81c-b9a0d5013330 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:51.764180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc223015-c1ac-492e-a81c-b9a0d5013330 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:51.766383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc223015-c1ac-492e-a81c-b9a0d5013330 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:51.772959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 492/1000] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:51.779308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:51.970020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32eb3-25d3-4a3e-93d4-5cae16f2e3c0 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.970263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32eb3-25d3-4a3e-93d4-5cae16f2e3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.970583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc32eb3-25d3-4a3e-93d4-5cae16f2e3c0 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.972153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 493/1001] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:51.977856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac669e8-6d04-49e6-8556-bcf011c02158 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:51.978143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac669e8-6d04-49e6-8556-bcf011c02158 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:51.978450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac669e8-6d04-49e6-8556-bcf011c02158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:51.991447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab5160b-f12c-4ec3-955c-ccc4ebcdb52c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:51.997648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-eac669e8-6d04-49e6-8556-bcf011c02158 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:51.998874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-eac669e8-6d04-49e6-8556-bcf011c02158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:52.031266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:52.052922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:52.062996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:52.064151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:52.064684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:52.065177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:52.066547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:52.067125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:52.069828 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:52.079552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 509/1002] 10.222.0.20 () {56 vars in 1112 bytes} [Thu Jun 30 12:38:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:52.088596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:52.112202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 494/1003] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:52.145976 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac669e8-6d04-49e6-8556-bcf011c02158 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:52.245616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38739f81-ed3f-4477-b1d7-86a4fe953605 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:52.293638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:52.294324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:52.294688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:52.294938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:52.296461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:52.298945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:52.329730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 510/1004] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:38:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:38:52.363785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac669e8-6d04-49e6-8556-bcf011c02158 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:52.454933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:52.456439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:52.456943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:52.457511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:52.458774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:52.461550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:52.487672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:52.489987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:52.491665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 495/1005] 10.222.0.20 () {56 vars in 1126 bytes} [Thu Jun 30 12:38:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:52.497401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:52.577120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:52.676329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c574394-e963-4a8b-bc0d-82ac44bdcf19 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:52.723606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:52.724527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:52.724937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:52.725340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:52.726221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:52.726657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:52.728205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:52.734754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 511/1006] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:52.740687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:52.770264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:52.879182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23ade2-08e5-49f1-845b-3ad05eacb410 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:52.922755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe73085-6e44-4edd-ba55-0d996a178b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:52.923685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe73085-6e44-4edd-ba55-0d996a178b91 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:52.924130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe73085-6e44-4edd-ba55-0d996a178b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:52.924624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe73085-6e44-4edd-ba55-0d996a178b91 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:52.925527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe73085-6e44-4edd-ba55-0d996a178b91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:52.925999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe73085-6e44-4edd-ba55-0d996a178b91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:52.927601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe73085-6e44-4edd-ba55-0d996a178b91 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:52.939704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 496/1007] 10.222.0.20 () {56 vars in 1122 bytes} [Thu Jun 30 12:38:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:52.941188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:53.078671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a0e620-c769-462a-8bbc-de003afb13dc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:53.099835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:53.124725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b63b3f-d23b-45de-a2a0-044f8035db71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:53.125591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b63b3f-d23b-45de-a2a0-044f8035db71 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:53.126082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b63b3f-d23b-45de-a2a0-044f8035db71 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:53.126516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b63b3f-d23b-45de-a2a0-044f8035db71 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:53.127562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b63b3f-d23b-45de-a2a0-044f8035db71 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:53.129357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b63b3f-d23b-45de-a2a0-044f8035db71 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:53.156699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 512/1008] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:38:52 2022] POST /identity/v3/endpoints => generated 325 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:54.304500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975342c-8448-4bde-b30e-06548bc3a2cb None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:54.305039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975342c-8448-4bde-b30e-06548bc3a2cb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:54.305484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4975342c-8448-4bde-b30e-06548bc3a2cb None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:54.308164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 497/1009] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:54.315862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490e91-7fbd-45c2-8da2-5f5aba900beb None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:54.316751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490e91-7fbd-45c2-8da2-5f5aba900beb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:54.316751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04490e91-7fbd-45c2-8da2-5f5aba900beb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:54.338360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-04490e91-7fbd-45c2-8da2-5f5aba900beb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:54.339598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-04490e91-7fbd-45c2-8da2-5f5aba900beb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:54.439464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 513/1010] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:54 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:38:54.465465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975342c-8448-4bde-b30e-06548bc3a2cb None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:54.649618 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:54.693374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4975342c-8448-4bde-b30e-06548bc3a2cb None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:54.770554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d8de6-0a07-4a6f-b0ec-4262d14d7dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:54.771943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d8de6-0a07-4a6f-b0ec-4262d14d7dfd None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:54.772492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d8de6-0a07-4a6f-b0ec-4262d14d7dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:54.773011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d8de6-0a07-4a6f-b0ec-4262d14d7dfd None admin] PATH_INFO: `/v3/services/image` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:54.774316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d8de6-0a07-4a6f-b0ec-4262d14d7dfd None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:54.777275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d8de6-0a07-4a6f-b0ec-4262d14d7dfd None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-d71d8de6-0a07-4a6f-b0ec-4262d14d7dfd None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:54.803100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:54.805387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:38:54.809271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:54.813027 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 498/1011] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jun 30 12:38:54 2022] GET /identity/v3/services/image => generated 86 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:54.816047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490e91-7fbd-45c2-8da2-5f5aba900beb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:55.036254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04490e91-7fbd-45c2-8da2-5f5aba900beb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:55.039856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:55.078128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb6ae-011c-4007-bc51-b15ef4cffe5d None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.078128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb6ae-011c-4007-bc51-b15ef4cffe5d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.078513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555cb6ae-011c-4007-bc51-b15ef4cffe5d None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.079919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 499/1012] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:55.085706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a24ba-8d98-45e2-a9b6-165c061e693f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.085998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a24ba-8d98-45e2-a9b6-165c061e693f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.086290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a24ba-8d98-45e2-a9b6-165c061e693f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.106691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-697a24ba-8d98-45e2-a9b6-165c061e693f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:55.107941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-697a24ba-8d98-45e2-a9b6-165c061e693f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:55.111116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:55.112297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.112788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.113244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.114426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:55.114918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:55.117317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:55.134768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 514/1013] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:55.136203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:55.227103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 500/1014] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:55.253288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a24ba-8d98-45e2-a9b6-165c061e693f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:55.304255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db87871-bf3f-42f0-b3a9-49805ab301f7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:55.350416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:55.351701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.351990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.352490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.353374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] RBAC: Adding query filter params (type=image) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:55.353917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:55.355797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:55.359720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:55.365194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 515/1015] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:55.394235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a24ba-8d98-45e2-a9b6-165c061e693f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:55.442739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccec2550-3e5b-4251-8963-8ef89c3e4125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:55.443873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec2550-3e5b-4251-8963-8ef89c3e4125 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.444318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec2550-3e5b-4251-8963-8ef89c3e4125 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.444878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccec2550-3e5b-4251-8963-8ef89c3e4125 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.459573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccec2550-3e5b-4251-8963-8ef89c3e4125 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-ccec2550-3e5b-4251-8963-8ef89c3e4125 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:38:55.468811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:55.470654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:55.471706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 501/1016] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 30 12:38:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:55.479638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:55.519963 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:55.596550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e789-0324-424d-9fe8-cf843b1961cd None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.596937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e789-0324-424d-9fe8-cf843b1961cd None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.597425 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3e789-0324-424d-9fe8-cf843b1961cd None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.600007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 502/1017] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:55.607114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edae208-3701-4013-a4f4-c385878ef158 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.607752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edae208-3701-4013-a4f4-c385878ef158 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.608314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edae208-3701-4013-a4f4-c385878ef158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.638180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1edae208-3701-4013-a4f4-c385878ef158 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:55.641203 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1edae208-3701-4013-a4f4-c385878ef158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:55.645537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf457a4-5c80-4307-9a14-390c05d39b11 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:55.705831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:55.707090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:55.707585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:55.708083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:55.709528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:55.710094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:55.712696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:55.728584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 516/1018] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 30 12:38:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:55.737255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:55.766794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 503/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:55 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:55.806751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edae208-3701-4013-a4f4-c385878ef158 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:55.901199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:55.925168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:55.939847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522c1252-b909-4d8d-9412-87a450892283 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:55.958212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edae208-3701-4013-a4f4-c385878ef158 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:56.007379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:56.008884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:56.009608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:56.010162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:56.011157 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:56.012752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:56.013221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:56.013685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:56.017102 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:56.019031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:56.022313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 504/1020] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:56.031004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:56.034694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:56.037024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:56.069194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:56.071006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:56.073086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:56.073086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:56.073086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:56.073086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:56.073086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 517/1021] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:56.080183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:56.200244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e340375-c2fa-452a-9541-b1a37e6b2fad None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:56.250571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:56.251673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:56.252115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:56.252595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:56.253501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:56.255224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:56.261134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:56.287363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4316348e-ebcf-4269-b3c7-17fae3ad784d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:56.292506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 505/1022] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:56 2022] POST /identity/v3/projects => generated 311 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:38:56.346190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:56.347096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:56.347518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:56.347937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:56.349018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:56.349498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:56.351160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:56.374340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 518/1023] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:56.376885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:56.519459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1b446f-3d49-4a3f-8777-bf03a08b0431 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:56.572427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:56.572427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:56.572427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:56.572427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:56.589388 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:56.592250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:38:56.626090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:56.627194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:38:56.628236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:38:56.628850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 506/1024] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:38:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:56.637587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:56.644783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:56.788008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980d01f5-6da6-4a53-933f-07f66f5516c4 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:56.834483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:56.835363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:56.835803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:56.836239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:56.837297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:56.837746 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:56.839349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:56.862700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 519/1025] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:38:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:56.869261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:56.970212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:57.078905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9561fb-3055-4aed-b559-c6f28e7f7042 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:57.146100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:57.147132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:57.147621 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:57.148082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:57.240864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:57.242789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:57.306552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:57.384582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 507/1026] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:38:56 2022] GET /identity/v3/auth/tokens => generated 1863 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 12:38:57.389273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:57.517480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:57.597434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5a9a43-9e9d-4af4-9031-dfd797205cce None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:57.679412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4038b6b6-edb0-4aef-a984-fe308139c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:57.680706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b6b6-edb0-4aef-a984-fe308139c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:57.681207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b6b6-edb0-4aef-a984-fe308139c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:57.681706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4038b6b6-edb0-4aef-a984-fe308139c9cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:57.704157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b6b6-edb0-4aef-a984-fe308139c9cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:57.707016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4038b6b6-edb0-4aef-a984-fe308139c9cb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-4038b6b6-edb0-4aef-a984-fe308139c9cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:38:57.743856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:57.744892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:57.745820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:38:57.745820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:38:57.745820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:38:57.745820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:57.751662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 520/1027] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:38:57.753225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:57.823926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b4c2f-6935-4b36-bf31-ef6e243dcc76 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:57.824401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b4c2f-6935-4b36-bf31-ef6e243dcc76 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:57.824860 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b4c2f-6935-4b36-bf31-ef6e243dcc76 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:57.826664 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 521/1028] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:38:57.833596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797545-2ecd-4b74-b042-c8bebff40d1f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:57.834057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797545-2ecd-4b74-b042-c8bebff40d1f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:57.834428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797545-2ecd-4b74-b042-c8bebff40d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:57.854922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f9797545-2ecd-4b74-b042-c8bebff40d1f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:57.856537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f9797545-2ecd-4b74-b042-c8bebff40d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:57.893568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0547624f-5291-4bdb-a512-94bf624fc498 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:57.958315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:57.959334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:57.959800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:57.960262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:57.961252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:57.961746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:57.962006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 522/1029] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:57 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:57.963559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:57.994117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 508/1030] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:38:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:38:58.000871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9797545-2ecd-4b74-b042-c8bebff40d1f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:58.006367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:58.020487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:58.080298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:58.159397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9797545-2ecd-4b74-b042-c8bebff40d1f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:58.177070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f4c50-e54a-43c9-94b9-7daa946edaa5 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:58.210370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:58.211131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:58.211417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:58.211695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:58.220358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:58.220729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:58.221371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:58.221754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:58.222133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:58.222813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:58.223085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:58.224727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:38:58.242275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:38:58.243352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:38:58.244859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 523/1031] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:38:58.250883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:58.256201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 509/1032] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:38:58 2022] POST /identity/v3/services => generated 242 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:38:58.402730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d1c2e-9177-4888-b62d-d8c44ebd40ff None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:58.406632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:58.462713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d34b29e-5866-4909-9f67-3585dfad5972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:58.463292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34b29e-5866-4909-9f67-3585dfad5972 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:58.463580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34b29e-5866-4909-9f67-3585dfad5972 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:58.463859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d34b29e-5866-4909-9f67-3585dfad5972 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:58.464708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34b29e-5866-4909-9f67-3585dfad5972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:58.465029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34b29e-5866-4909-9f67-3585dfad5972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:58.466523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d34b29e-5866-4909-9f67-3585dfad5972 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:58.481271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 524/1033] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:38:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:58.488724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:58.623434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:38:58.704621 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f14b0-1635-450d-bcf7-21b8ad8711f7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:38:58.751256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c641e214-77ee-497d-9189-3bc612fadbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:38:58.752039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e214-77ee-497d-9189-3bc612fadbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:58.752493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e214-77ee-497d-9189-3bc612fadbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:58.752676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c641e214-77ee-497d-9189-3bc612fadbc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:58.753557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e214-77ee-497d-9189-3bc612fadbc8 None admin] RBAC: Adding query filter params (role.id=f64b40787f2d46b488f5c4a5e53cce06, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=5f39f1ea697c4426b30a5e6fa795e4e4) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:38:58.753986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e214-77ee-497d-9189-3bc612fadbc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:38:58.755517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c641e214-77ee-497d-9189-3bc612fadbc8 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:38:58.762978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 510/1034] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:38:58 2022] GET /identity/v3/role_assignments?user.id=5f39f1ea697c4426b30a5e6fa795e4e4&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=f64b40787f2d46b488f5c4a5e53cce06 => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:38:59.510644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d964-d306-4ff6-83a9-7dcf2e02506a None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:59.511229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d964-d306-4ff6-83a9-7dcf2e02506a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:59.511733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b702d964-d306-4ff6-83a9-7dcf2e02506a None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:59.514645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 525/1035] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:38:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:38:59.521143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c47055-3dff-4b81-8a9e-a7176d24e9e1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:38:59.521940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c47055-3dff-4b81-8a9e-a7176d24e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:38:59.521940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c47055-3dff-4b81-8a9e-a7176d24e9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:38:59.551041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-74c47055-3dff-4b81-8a9e-a7176d24e9e1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:38:59.553418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-74c47055-3dff-4b81-8a9e-a7176d24e9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:38:59.716947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 511/1036] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:38:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:38:59.760473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d964-d306-4ff6-83a9-7dcf2e02506a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:38:59.982007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b702d964-d306-4ff6-83a9-7dcf2e02506a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:00.054620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29498b5a-b35b-4eb5-ab9c-edf3889f2298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:00.055902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498b5a-b35b-4eb5-ab9c-edf3889f2298 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:00.056377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498b5a-b35b-4eb5-ab9c-edf3889f2298 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:00.056887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29498b5a-b35b-4eb5-ab9c-edf3889f2298 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:00.059063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29498b5a-b35b-4eb5-ab9c-edf3889f2298 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:00.062482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29498b5a-b35b-4eb5-ab9c-edf3889f2298 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:00.066047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 526/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:38:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:00.075625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c47055-3dff-4b81-8a9e-a7176d24e9e1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:00.216919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:00.302626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c47055-3dff-4b81-8a9e-a7176d24e9e1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:00.372836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a771c-09fb-45dd-9659-460622789854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:00.375203 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a771c-09fb-45dd-9659-460622789854 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:00.375203 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a771c-09fb-45dd-9659-460622789854 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:00.375670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a771c-09fb-45dd-9659-460622789854 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:00.376971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a771c-09fb-45dd-9659-460622789854 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:00.379850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a771c-09fb-45dd-9659-460622789854 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:00.419120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 512/1038] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:39:00 2022] POST /identity/v3/users => generated 285 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:39:00.459196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a06977-acae-44de-9430-b4e92670ef41 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:00.459626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a06977-acae-44de-9430-b4e92670ef41 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:00.459912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a06977-acae-44de-9430-b4e92670ef41 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:00.461687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 527/1039] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:00.468211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db661-9af7-43db-9520-7c39b6a35974 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:00.468682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db661-9af7-43db-9520-7c39b6a35974 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:00.468833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4db661-9af7-43db-9520-7c39b6a35974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:00.489851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9f4db661-9af7-43db-9520-7c39b6a35974 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:00.491280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9f4db661-9af7-43db-9520-7c39b6a35974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:00.584239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 513/1040] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:00.608966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a06977-acae-44de-9430-b4e92670ef41 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:00.650082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:00.805226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a06977-acae-44de-9430-b4e92670ef41 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:00.879374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:00.880722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:00.881224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:00.881719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] PATH_INFO: `/v3/services/image` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:00.882966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:00.885678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:00.909701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:00.910883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:39:00.911798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:00.912813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 528/1041] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jun 30 12:39:00 2022] GET /identity/v3/services/image => generated 86 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:00.919686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db661-9af7-43db-9520-7c39b6a35974 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:01.015753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:01.087531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4db661-9af7-43db-9520-7c39b6a35974 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:01.133553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe036ef-4eeb-414b-b049-7ceb97615652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:01.134139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe036ef-4eeb-414b-b049-7ceb97615652 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:01.134431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe036ef-4eeb-414b-b049-7ceb97615652 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:01.134716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe036ef-4eeb-414b-b049-7ceb97615652 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:01.135813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe036ef-4eeb-414b-b049-7ceb97615652 None admin] RBAC: Adding query filter params (name=image) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:01.136136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe036ef-4eeb-414b-b049-7ceb97615652 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:01.137721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe036ef-4eeb-414b-b049-7ceb97615652 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:01.144443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 514/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:01.150900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:01.227953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ccfd4-8eef-48b2-b161-fa3d8cfd719f None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:01.228246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ccfd4-8eef-48b2-b161-fa3d8cfd719f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:01.228646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3ccfd4-8eef-48b2-b161-fa3d8cfd719f None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:01.230203 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 515/1043] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:01.237000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0e02-5075-4370-9d5f-d65f8fbe5245 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:01.237284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0e02-5075-4370-9d5f-d65f8fbe5245 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:01.237555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232b0e02-5075-4370-9d5f-d65f8fbe5245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:01.262477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-232b0e02-5075-4370-9d5f-d65f8fbe5245 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:01.263868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-232b0e02-5075-4370-9d5f-d65f8fbe5245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:01.349162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:01.362934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 516/1044] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:01.369007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876e79c-0f49-4347-90f7-3c81a3de0072 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:01.390537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0e02-5075-4370-9d5f-d65f8fbe5245 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:01.444982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:01.447049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:01.447550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:01.448028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:01.450160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] RBAC: Adding query filter params (type=image) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:01.450738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:01.451684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:01.454205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:01.469690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 529/1045] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:01.471609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:01.564747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232b0e02-5075-4370-9d5f-d65f8fbe5245 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:01.614321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:01.615744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:01.616199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:01.616654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:01.632443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:01.644075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:01.646210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:39:01.648017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:01.652678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 517/1046] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 30 12:39:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:01.654585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:01.678183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3db1cdc-5b76-4780-b15a-374c4395bd38 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:01.732867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:01.734292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:01.734724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:01.735150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:01.736139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] RBAC: Adding query filter params (interface=public, service_id=2f9d33c1d03043ed98ddb771584c66f2, region_id=RegionOne) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:01.736642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:01.738718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:01.748439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 530/1047] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:39:01 2022] GET /identity/v3/endpoints?service_id=2f9d33c1d03043ed98ddb771584c66f2&interface=public®ion_id=RegionOne => generated 194 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:01.755748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:01.798674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:01.852260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c09d17-cffd-46ad-aff5-6239fff1dbdf None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:01.855700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:01.926277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:01.926915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:01.927180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:01.927474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:01.928247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:01.928603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:01.930046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:01.945229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 518/1048] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 30 12:39:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:01.946207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:01.948166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7006952-9588-4792-94e9-2445796deca7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:02.000659 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:02.001364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:02.001653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:02.001929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:02.002648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:02.004209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:02.013167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 531/1049] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:39:01 2022] GET /identity/v3/services => generated 1957 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:39:02.089915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c12cc6-4348-427e-b083-08c168254707 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:02.143456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:02.144311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:02.144635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:02.144924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:02.160335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:02.162066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:39:02.192277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:02.194350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:02.196160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:39:02.196160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:39:02.196160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:02.196160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:02.196160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 519/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:02.203428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:02.378710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:02.403328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9715e7-bee9-4c8c-9ed5-885999e38b9f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:02.465913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:02.466940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:02.467488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:02.467977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:02.469418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:02.469982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:02.472743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:02.499249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 532/1051] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:02.508742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:02.548713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:02.700765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22b9f67-9a40-48a1-8c9b-875d13af04d7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:02.766497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:02.768165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:02.768703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:02.769201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:02.784638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:02.787531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:39:02.817074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:02.818149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:39:02.819123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:02.824943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 520/1052] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:39:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:02.826054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:03.005602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4242808e-b200-48ef-a022-1caa29e89a09 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:03.051441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:03.052081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:03.052423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:03.052698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:03.053580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:03.053898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:03.055415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:03.084598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 533/1053] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:39:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:03.087306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:03.255123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:03.306147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd6f10-e70e-45ae-b7ab-59f9184789a9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:03.378637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904eafe-debc-4fa0-b824-6ac558f80c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:03.380377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904eafe-debc-4fa0-b824-6ac558f80c8c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:03.381129 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904eafe-debc-4fa0-b824-6ac558f80c8c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:03.381616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904eafe-debc-4fa0-b824-6ac558f80c8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:03.403766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904eafe-debc-4fa0-b824-6ac558f80c8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:03.406545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904eafe-debc-4fa0-b824-6ac558f80c8c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-3904eafe-debc-4fa0-b824-6ac558f80c8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:39:03.446777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:03.448591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:03.450393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:39:03.450393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:39:03.450393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:03.450393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:03.450393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 521/1054] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:03.456156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:03.459256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:03.582308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375ebfc4-a474-465a-9d8f-71c6a23e1608 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:03.586146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4109de-278b-46ad-be80-ac55e7c2fb09 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:03.586613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4109de-278b-46ad-be80-ac55e7c2fb09 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:03.587020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4109de-278b-46ad-be80-ac55e7c2fb09 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:03.588915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 522/1055] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:03.595614 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff6e2-eade-4cf7-b172-676f27fa694e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:03.596070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff6e2-eade-4cf7-b172-676f27fa694e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:03.596552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeff6e2-eade-4cf7-b172-676f27fa694e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:03.625049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:03.625743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:03.626032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:03.626319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:03.627071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:03.627387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:03.628847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:03.631004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1aeff6e2-eade-4cf7-b172-676f27fa694e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:03.633940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1aeff6e2-eade-4cf7-b172-676f27fa694e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:03.648554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 534/1056] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:03.650743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:03.766503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:03.778579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 523/1057] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:03.804859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff6e2-eade-4cf7-b172-676f27fa694e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:03.848128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6a7ae-1d55-4dc9-b0eb-4c011e1e7a48 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:03.907097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:03.914620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:03.916024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:03.916624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:03.917113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:03.930449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:03.933279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:39:03.962269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:03.964110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:03.966106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 535/1058] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:39:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:03.975132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:04.000678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeff6e2-eade-4cf7-b172-676f27fa694e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:04.073060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:04.074379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.074888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.075398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.098737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:04.108855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b71425-7580-41f5-8fb8-e2a1e6a75d68 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:04.113685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:04.115637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:04.117389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 524/1059] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:39:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:04.122404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:04.155234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:04.188616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:04.189822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.191247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.191667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.193688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:04.194245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:04.198385 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:04.226211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 536/1060] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:39:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:04.237961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:04.269573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407edbbc-0903-413d-88bf-f9fd9f0851a3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:04.298657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:04.317685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:04.318577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.319057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.319482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.320439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:04.320967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:04.322959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:04.340448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 525/1061] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:04.342345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:04.454826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d159a9b-39be-4f16-82af-d146ec85e416 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:04.496796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923ee24a-6a94-4edf-861b-407151e34a3b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:04.517642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:04.519714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.520590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.521359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/5f39f1ea697c4426b30a5e6fa795e4e4/roles/f64b40787f2d46b488f5c4a5e53cce06` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.525999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=5f39f1ea697c4426b30a5e6fa795e4e4, role_id=f64b40787f2d46b488f5c4a5e53cce06)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:04.528889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:04.541590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd227802-aa68-4522-81ca-aa46ff791a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:04.542503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd227802-aa68-4522-81ca-aa46ff791a3f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.542834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd227802-aa68-4522-81ca-aa46ff791a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.543117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd227802-aa68-4522-81ca-aa46ff791a3f None admin] PATH_INFO: `/v3/users/c14a2e3f08f345c99f3c04940fddb757` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.554844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 537/1062] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:39:04 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/5f39f1ea697c4426b30a5e6fa795e4e4/roles/f64b40787f2d46b488f5c4a5e53cce06 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:39:04.573645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd227802-aa68-4522-81ca-aa46ff791a3f None admin] RBAC: Authorizing `identity:get_user(user_id=c14a2e3f08f345c99f3c04940fddb757)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:04.575651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd227802-aa68-4522-81ca-aa46ff791a3f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:04.578779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 526/1063] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:04 2022] GET /identity/v3/users/c14a2e3f08f345c99f3c04940fddb757 => generated 285 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:04.585480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:04.678726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:04.746252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2e378-ec43-4b0c-af7b-44c657165dce None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.746919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2e378-ec43-4b0c-af7b-44c657165dce None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.747213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a2e378-ec43-4b0c-af7b-44c657165dce None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.750689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 527/1064] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:04.757234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5666-e617-4c61-9738-f47bd1596bc7 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.757689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5666-e617-4c61-9738-f47bd1596bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.758086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f5666-e617-4c61-9738-f47bd1596bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.781517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a10f5666-e617-4c61-9738-f47bd1596bc7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:04.782808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a10f5666-e617-4c61-9738-f47bd1596bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:04.804330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e5fc7-0f44-44e2-9e43-608d72e39357 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:04.824985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:04.858195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:04.859588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:04.860039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:04.860326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:04.884285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 528/1065] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:04.909779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f5666-e617-4c61-9738-f47bd1596bc7 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:04.944728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:04.946244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:05.015114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:05.045169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f5666-e617-4c61-9738-f47bd1596bc7 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:05.095343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:05.096827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:05.097354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:05.097869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:05.099145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:05.101809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:05.111101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 538/1066] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:04 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:05.117421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:05.127167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:05.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:05.130496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 529/1067] 10.222.0.20 () {56 vars in 1105 bytes} [Thu Jun 30 12:39:04 2022] GET /identity/v3/services/image => generated 86 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:05.135194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:05.175139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:05.267899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee17698-b473-425c-aef7-cde70711fb1f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:05.268527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f35cbf-39f0-4c33-8639-ca0913f20ea6 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:05.323291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:05.323666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:05.323982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:05.324272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:05.324588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:05.325086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:05.325324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] RBAC: Adding query filter params (name=image) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:05.325641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:05.325743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:05.326131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:05.327257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:05.329361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] RBAC: Authorizing `identity:get_project(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:05.332061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:05.340567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 539/1068] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:05 2022] GET /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2 => generated 311 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:05.342128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:05.343840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 530/1069] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:05.350090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:05.363048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:05.483807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f052b4f-6925-40de-a4f5-2e2b5b0da912 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:05.489575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:05.499168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9c0f66-69ef-48de-a44e-99c5b1ecec54 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:05.536098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:05.537083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:05.537458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:05.537804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:05.538906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2, user.id=c14a2e3f08f345c99f3c04940fddb757) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:05.539292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:05.541073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:05.547905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e2cb79-f1ee-4189-86c9-6cd51a84c4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:05.548527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 540/1070] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:05 2022] GET /identity/v3/role_assignments?user.id=c14a2e3f08f345c99f3c04940fddb757&scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:05.549150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2cb79-f1ee-4189-86c9-6cd51a84c4cf None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:05.549439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2cb79-f1ee-4189-86c9-6cd51a84c4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:05.549720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e2cb79-f1ee-4189-86c9-6cd51a84c4cf None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:05.550473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2cb79-f1ee-4189-86c9-6cd51a84c4cf None admin] RBAC: Adding query filter params (type=image) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:05.550807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2cb79-f1ee-4189-86c9-6cd51a84c4cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:05.552254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e2cb79-f1ee-4189-86c9-6cd51a84c4cf None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:05.562993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 531/1071] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:05.569185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:05.660092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:05.695920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578782e-1ccd-4f13-9140-2268bb166d28 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:05.738441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c31b2-3d4a-4fcf-9923-2e78814215f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:05.739140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c31b2-3d4a-4fcf-9923-2e78814215f3 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:05.739434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c31b2-3d4a-4fcf-9923-2e78814215f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:05.739717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c31b2-3d4a-4fcf-9923-2e78814215f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:05.740532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c31b2-3d4a-4fcf-9923-2e78814215f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:05.741973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c31b2-3d4a-4fcf-9923-2e78814215f3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:05.772416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 541/1072] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:39:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:39:07.787406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde06b6-d251-4152-b6d3-fa547cc37d95 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:07.787937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde06b6-d251-4152-b6d3-fa547cc37d95 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:07.788445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dde06b6-d251-4152-b6d3-fa547cc37d95 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:07.791861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 532/1073] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:07.798671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbc5bd-23c1-4766-a547-1701f9cbafba None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:07.799182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbc5bd-23c1-4766-a547-1701f9cbafba None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:07.799289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cbc5bd-23c1-4766-a547-1701f9cbafba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:07.817960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f0cbc5bd-23c1-4766-a547-1701f9cbafba None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:07.819387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f0cbc5bd-23c1-4766-a547-1701f9cbafba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:07.911084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 542/1074] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:07.936709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde06b6-d251-4152-b6d3-fa547cc37d95 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:08.108346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8b5b-4856-4bcc-ab2d-60c4be396e2b None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.108905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8b5b-4856-4bcc-ab2d-60c4be396e2b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.109444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a8b5b-4856-4bcc-ab2d-60c4be396e2b None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.112030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 543/1075] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:08.114420 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68cc2-cc78-4669-98e8-2d0dcf016a7f None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.114915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68cc2-cc78-4669-98e8-2d0dcf016a7f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.115405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef68cc2-cc78-4669-98e8-2d0dcf016a7f None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.118475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 544/1076] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:08.120630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e5a2-1f1d-4828-b664-463b7f621cb4 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.121145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e5a2-1f1d-4828-b664-463b7f621cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.121641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e8e5a2-1f1d-4828-b664-463b7f621cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.125925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dde06b6-d251-4152-b6d3-fa547cc37d95 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:08.150156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-28e8e5a2-1f1d-4828-b664-463b7f621cb4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:08.152268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-28e8e5a2-1f1d-4828-b664-463b7f621cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:08.166755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489e5440-ce70-4041-98cc-0e633a763faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:08.167588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e5440-ce70-4041-98cc-0e633a763faa None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.167874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e5440-ce70-4041-98cc-0e633a763faa None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.168186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489e5440-ce70-4041-98cc-0e633a763faa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.182137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489e5440-ce70-4041-98cc-0e633a763faa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-489e5440-ce70-4041-98cc-0e633a763faa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:08.190977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:08.193048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 533/1077] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:08.194933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad4fa-7067-4365-85e7-453fe89a8784 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.196671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad4fa-7067-4365-85e7-453fe89a8784 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.196671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fad4fa-7067-4365-85e7-453fe89a8784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.213878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d8fad4fa-7067-4365-85e7-453fe89a8784 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:08.215154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d8fad4fa-7067-4365-85e7-453fe89a8784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:08.235121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:08.239280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:08.267466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 545/1078] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:08.268540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e5a2-1f1d-4828-b664-463b7f621cb4 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:08.323266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 534/1079] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:08.324595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad4fa-7067-4365-85e7-453fe89a8784 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:08.433936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e8e5a2-1f1d-4828-b664-463b7f621cb4 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:08.461155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fad4fa-7067-4365-85e7-453fe89a8784 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:08.482209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:08.483172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.483667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.484052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.485463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:08.485900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:08.487435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:08.502302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 546/1080] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:39:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:08.502302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:08.527872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:08.528859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.529314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.530437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.550748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:08.561969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:08.567952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:08.569471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:08.570464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 535/1081] 10.222.0.20 () {56 vars in 1120 bytes} [Thu Jun 30 12:39:08 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:08.571918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:08.594468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:08.631585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e86ed3-e4f8-4797-ab25-60126665cdbc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:08.677947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:08.678976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.679440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.679649 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.725435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c499e7-ccc5-489e-83e1-7d50aa1f6b47 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:08.771556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:08.772471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.772763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.773047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] PATH_INFO: `/v3/users/c14a2e3f08f345c99f3c04940fddb757` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.774341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] RBAC: Authorizing `identity:get_user(user_id=c14a2e3f08f345c99f3c04940fddb757)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:08.775896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:08.777758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 536/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:08 2022] GET /identity/v3/users/c14a2e3f08f345c99f3c04940fddb757 => generated 285 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:08.778132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:08.778564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:08.781414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:08.850248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:08.901728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:08.928077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 547/1083] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:08.928995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:08.932951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b061ca9d-ab77-487c-89f6-a32967190884 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:08.982328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:08.983709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:08.984088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:08.984506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:08.985387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:08.985795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:08.987398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:09.000225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 537/1084] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 30 12:39:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:09.001561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:09.084705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc81e48-4d4a-43a6-9265-ff321fe4cf48 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:09.128904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:09.129787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:09.130082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:09.130368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:09.131691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] RBAC: Authorizing `identity:get_project(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:09.133159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:09.134938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 548/1085] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:08 2022] GET /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2 => generated 311 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:09.135748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:09.161777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:09.171921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649866ef-0a21-437c-97ea-78a20e150141 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:09.212093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:09.212941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:09.213224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:09.213506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:09.224158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:09.227305 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:09.230649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:39:09.263923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:09.266453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:09.275003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:39:09.275003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:39:09.275003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:09.275003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:09.275003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 538/1086] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:09.275003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:09.281961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54b418-7772-444f-878c-7ec3e605a77f None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:09.320716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:09.321518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:09.321808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:09.322089 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:09.333713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:09.335205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:39:09.364961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:09.365979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:09.366885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:39:09.366885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:39:09.366885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:09.366885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:09.367550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 549/1087] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:09.368732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:09.422726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c7a7f-ea16-4f20-a9d2-663641175893 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:09.463496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:09.464455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:09.464748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:09.465031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2/users/c14a2e3f08f345c99f3c04940fddb757/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:09.467855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] RBAC: Authorizing `identity:create_grant(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2, user_id=c14a2e3f08f345c99f3c04940fddb757, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:09.469853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:09.486568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 539/1088] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:39:09 2022] PUT /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2/users/c14a2e3f08f345c99f3c04940fddb757/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:39:09.487685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:09.493683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:09.549343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ad53b8-7162-46eb-85bd-361be32636d3 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:09.599188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:09.599877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:09.600280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:09.600571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:09.601350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:09.601659 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:09.603120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:09.609624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:09.619358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 550/1089] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:09.706656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3230bf-c5eb-4307-899f-4a505883fecd None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:09.760878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:09.761584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:09.762007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:09.762185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:09.762932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:09.763251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:09.765717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:09.784569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 540/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:09.789980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:09.947712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb3a2f-0bfe-4da2-a667-14e86ff8da24 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:10.004587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:10.021457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:10.022834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:10.023336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:10.023900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:10.036910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:10.038521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:39:10.055575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:10.057574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:10.059499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 551/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Thu Jun 30 12:39:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:10.064583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:10.198822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0c8db-d791-481c-befa-cfcfddb67b68 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:10.217422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:10.256825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:10.257989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:10.258491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:10.259007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:10.260685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:10.261256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:10.264616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:10.304704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 541/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Thu Jun 30 12:39:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:10.306093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:10.449332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414190f-0dbf-4049-967b-a764345c011e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:10.491236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:10.491902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:10.492182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:10.492501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:10.569265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:10.584873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:10.586345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:10.725149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 552/1093] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:10.731741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:10.880512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac14b37-2817-44ed-a284-1dde6ab69bbb None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:10.949134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:10.950506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:10.951001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:10.951510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:10.972100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:10.974814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:39:11.018617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:11.019611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:11.020579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:39:11.020579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:39:11.020579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:39:11.020579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:11.026233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 542/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:11.030761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:11.180078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:11.198388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58438e8-1f56-4a90-b8ae-5bace2183cb2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:11.244006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:11.245092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:11.245092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:11.245384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:11.246189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:11.246541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:11.248163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:11.263639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 553/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:11.271038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:11.317601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:11.421996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183496f3-0295-41f9-afb7-01a1c54af6d7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:11.466038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:11.466936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:11.467437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:11.468140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:11.476123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:11.477766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:39:11.494258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:11.496080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:11.497887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 543/1096] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:39:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:11.503063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:11.699167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bad7bb-3a6c-4c05-bb2d-555983cef4e1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:11.743354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6655b5e5-0ae3-4436-ad26-2d93e4795145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:11.744131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b5e5-0ae3-4436-ad26-2d93e4795145 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:11.744524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b5e5-0ae3-4436-ad26-2d93e4795145 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:11.744878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6655b5e5-0ae3-4436-ad26-2d93e4795145 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:11.745766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655b5e5-0ae3-4436-ad26-2d93e4795145 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:11.746150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655b5e5-0ae3-4436-ad26-2d93e4795145 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:11.747830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6655b5e5-0ae3-4436-ad26-2d93e4795145 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:11.773608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 554/1097] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:39:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:11.775786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:11.896030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f89d8-44a6-4614-93de-f39188a990d3 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:11.896486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f89d8-44a6-4614-93de-f39188a990d3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:11.896873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631f89d8-44a6-4614-93de-f39188a990d3 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:11.898527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 555/1098] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:11.904850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a855-eafa-4b51-82f4-37bbfe60f4c6 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:11.905216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a855-eafa-4b51-82f4-37bbfe60f4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:11.905826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d59a855-eafa-4b51-82f4-37bbfe60f4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:11.912146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:11.930340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1d59a855-eafa-4b51-82f4-37bbfe60f4c6 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:11.931704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1d59a855-eafa-4b51-82f4-37bbfe60f4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:11.934604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:11.942000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a10b8b1-bd36-434a-8f93-8d8a32134653 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:11.982350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:11.983563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:11.983849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:11.984152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:11.985074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] RBAC: Adding query filter params (role.id=f64b40787f2d46b488f5c4a5e53cce06, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=5f39f1ea697c4426b30a5e6fa795e4e4) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:11.985403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:11.986892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:11.993909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 544/1099] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:11 2022] GET /identity/v3/role_assignments?user.id=5f39f1ea697c4426b30a5e6fa795e4e4&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=f64b40787f2d46b488f5c4a5e53cce06 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:12.060790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 556/1100] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:12.086531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:12.224428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455c366e-c3e1-4608-92b3-6261f7bb46e3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:12.279112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:12.280638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:12.280984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:12.281354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:12.297258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:12.307570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:12.309542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:12.311215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 545/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:39:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:12.320294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59a855-eafa-4b51-82f4-37bbfe60f4c6 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:12.469841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d59a855-eafa-4b51-82f4-37bbfe60f4c6 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:12.527594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:12.528759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:12.529225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:12.530234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:12.531132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:12.531513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:12.533091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:12.543189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:12.549232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 557/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:39:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:12.559005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:12.571938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:12.707757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026f028-4ee2-4ef0-ae2b-2b42bd9faf7c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:12.755943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:12.757249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:12.757613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:12.757966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] PATH_INFO: `/v3/users/c14a2e3f08f345c99f3c04940fddb757` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:12.759515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] RBAC: Authorizing `identity:get_user(user_id=c14a2e3f08f345c99f3c04940fddb757)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:12.761580 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:12.763452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 546/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:12 2022] GET /identity/v3/users/c14a2e3f08f345c99f3c04940fddb757 => generated 285 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:12.770566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:12.940831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b2b37-636c-4fa2-8f43-92028a7d8e9d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:12.997113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:12.998805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:12.999323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:12.999911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:13.102333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:13.107080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:13.109674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:13.233734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 558/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:13.240290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:13.331882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:13.361024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3302c-df18-450e-8023-65bfe442d81a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:13.403280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4494e-4fb6-43ba-a254-9ff78a88451b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:13.404260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4494e-4fb6-43ba-a254-9ff78a88451b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:13.404666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4494e-4fb6-43ba-a254-9ff78a88451b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:13.405124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4494e-4fb6-43ba-a254-9ff78a88451b None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:13.406665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4494e-4fb6-43ba-a254-9ff78a88451b None admin] RBAC: Authorizing `identity:get_project(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:13.408589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4494e-4fb6-43ba-a254-9ff78a88451b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:13.410721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 547/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:13 2022] GET /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:13.417720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:13.535784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:13.539571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6956d2da-eeb2-4d2e-9f2f-c72e1a1778bf None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:13.582028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abf8857-2048-424f-9dd4-3f7e04e73e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:13.582702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8857-2048-424f-9dd4-3f7e04e73e4d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:13.582993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8857-2048-424f-9dd4-3f7e04e73e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:13.583278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abf8857-2048-424f-9dd4-3f7e04e73e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:13.584129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf8857-2048-424f-9dd4-3f7e04e73e4d None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2, user.id=c14a2e3f08f345c99f3c04940fddb757) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:13.584544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf8857-2048-424f-9dd4-3f7e04e73e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:13.586028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abf8857-2048-424f-9dd4-3f7e04e73e4d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:13.593159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 559/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:13 2022] GET /identity/v3/role_assignments?user.id=c14a2e3f08f345c99f3c04940fddb757&scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:15.772785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e99b0-f14c-4119-b650-8aa2ba5d0d26 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:15.773607 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e99b0-f14c-4119-b650-8aa2ba5d0d26 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:15.773762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e99b0-f14c-4119-b650-8aa2ba5d0d26 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:15.775281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 548/1107] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:15.782340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a19de-6147-4ce3-b475-79f186ab2e09 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:15.782913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a19de-6147-4ce3-b475-79f186ab2e09 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:15.782913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a19de-6147-4ce3-b475-79f186ab2e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:15.801875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-746a19de-6147-4ce3-b475-79f186ab2e09 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:15.803133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-746a19de-6147-4ce3-b475-79f186ab2e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:15.900351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 560/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:15 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:15.945372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e99b0-f14c-4119-b650-8aa2ba5d0d26 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:16.070871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e99b0-f14c-4119-b650-8aa2ba5d0d26 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:16.117734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359290a7-475d-4993-8cc9-28e2b52db0b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:16.118670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359290a7-475d-4993-8cc9-28e2b52db0b4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:16.119027 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359290a7-475d-4993-8cc9-28e2b52db0b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:16.119507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359290a7-475d-4993-8cc9-28e2b52db0b4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:16.121107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359290a7-475d-4993-8cc9-28e2b52db0b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:16.122770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359290a7-475d-4993-8cc9-28e2b52db0b4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:16.125333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 549/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:16.132017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a19de-6147-4ce3-b475-79f186ab2e09 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:16.298220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:16.312143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a19de-6147-4ce3-b475-79f186ab2e09 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:16.377267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f435be-9230-4ac7-b83c-d1a8ad72b8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:16.378432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f435be-9230-4ac7-b83c-d1a8ad72b8a0 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:16.378931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f435be-9230-4ac7-b83c-d1a8ad72b8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:16.379447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f435be-9230-4ac7-b83c-d1a8ad72b8a0 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:16.380897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f435be-9230-4ac7-b83c-d1a8ad72b8a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:16.383691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f435be-9230-4ac7-b83c-d1a8ad72b8a0 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:16.420744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 561/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:39:16 2022] POST /identity/v3/users => generated 286 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:39:18.731451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb479-165e-4cbb-bb76-8b269c1b13a9 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:18.732041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb479-165e-4cbb-bb76-8b269c1b13a9 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:18.732041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995cb479-165e-4cbb-bb76-8b269c1b13a9 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:18.734468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 550/1111] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:18.744120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e2fa2-a0e1-4d37-a356-ec738419bb11 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:18.744713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e2fa2-a0e1-4d37-a356-ec738419bb11 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:18.745154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e2fa2-a0e1-4d37-a356-ec738419bb11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:18.773227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9f3e2fa2-a0e1-4d37-a356-ec738419bb11 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:18.774551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9f3e2fa2-a0e1-4d37-a356-ec738419bb11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:18.854140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 562/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:18.880725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb479-165e-4cbb-bb76-8b269c1b13a9 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:18.895523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:19.023578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995cb479-165e-4cbb-bb76-8b269c1b13a9 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:19.090151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:19.091361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:19.092281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:19.092609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] PATH_INFO: `/v3/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:19.096697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] RBAC: Authorizing `identity:get_role(role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:19.098944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:19.101553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 551/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:18 2022] GET /identity/v3/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 223 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:19.108857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e2fa2-a0e1-4d37-a356-ec738419bb11 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:19.226644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:19.265889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e2fa2-a0e1-4d37-a356-ec738419bb11 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:19.313014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:19.313826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:19.314117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:19.314403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] PATH_INFO: `/v3/users/a057c2609c15452ea53e49fbeb8cd284` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:19.335878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] RBAC: Authorizing `identity:get_user(user_id=a057c2609c15452ea53e49fbeb8cd284)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:19.337411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:19.339265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 563/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:19 2022] GET /identity/v3/users/a057c2609c15452ea53e49fbeb8cd284 => generated 286 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:19.345973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:19.508691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:19.549479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1019f3-8b2b-4660-b286-8526a63157d4 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:19.604796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:19.605358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:19.605648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:19.605940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:19.699401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:19.700999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:19.814586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:19.846216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 552/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 12:39:19.853777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:20.005606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240d97b9-9db0-4cd9-9768-5528b28092fc None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:20.054306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84ec84-914d-4e2a-81fd-33c4b188eab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:20.055176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84ec84-914d-4e2a-81fd-33c4b188eab3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:20.055462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84ec84-914d-4e2a-81fd-33c4b188eab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:20.055743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84ec84-914d-4e2a-81fd-33c4b188eab3 None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:20.057047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84ec84-914d-4e2a-81fd-33c4b188eab3 None admin] RBAC: Authorizing `identity:get_project(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:20.058505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b84ec84-914d-4e2a-81fd-33c4b188eab3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:20.060286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 564/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:19 2022] GET /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2 => generated 311 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:20.071605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:20.257292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4dd896-03a1-4a31-8e2d-b04f83bdaf87 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:20.321213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3fe877-e3f7-4b9e-9434-b474baeaa0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:20.321964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe877-e3f7-4b9e-9434-b474baeaa0aa None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:20.322316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe877-e3f7-4b9e-9434-b474baeaa0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:20.322648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3fe877-e3f7-4b9e-9434-b474baeaa0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:20.323570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fe877-e3f7-4b9e-9434-b474baeaa0aa None admin] RBAC: Adding query filter params (role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2, user.id=a057c2609c15452ea53e49fbeb8cd284) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:20.323938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fe877-e3f7-4b9e-9434-b474baeaa0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:20.325522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3fe877-e3f7-4b9e-9434-b474baeaa0aa None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:20.333069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 553/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:20 2022] GET /identity/v3/role_assignments?user.id=a057c2609c15452ea53e49fbeb8cd284&scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:22.534936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8440684-9377-44d2-9ca2-7f88717b65d5 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:22.535577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8440684-9377-44d2-9ca2-7f88717b65d5 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:22.535577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8440684-9377-44d2-9ca2-7f88717b65d5 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:22.537280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 565/1118] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:22.543651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfb745-7cf9-463b-a59b-5275f08c85f8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:22.544191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfb745-7cf9-463b-a59b-5275f08c85f8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:22.544191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bfb745-7cf9-463b-a59b-5275f08c85f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:22.562832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-67bfb745-7cf9-463b-a59b-5275f08c85f8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:22.564073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-67bfb745-7cf9-463b-a59b-5275f08c85f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:22.608570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:22.662931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 554/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:22.690610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8440684-9377-44d2-9ca2-7f88717b65d5 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:22.702194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:22.816931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8440684-9377-44d2-9ca2-7f88717b65d5 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:22.857454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:22.858358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:22.858754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:22.859129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] PATH_INFO: `/v3/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:22.860872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] RBAC: Authorizing `identity:get_role(role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:22.862383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:22.863829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 566/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:22 2022] GET /identity/v3/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 223 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:22.870095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfb745-7cf9-463b-a59b-5275f08c85f8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:22.991274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bfb745-7cf9-463b-a59b-5275f08c85f8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:23.032233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:23.033174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:23.033473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:23.033758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] PATH_INFO: `/v3/users/a057c2609c15452ea53e49fbeb8cd284` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:23.035118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] RBAC: Authorizing `identity:get_user(user_id=a057c2609c15452ea53e49fbeb8cd284)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:23.036678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:23.038453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 555/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:22 2022] GET /identity/v3/users/a057c2609c15452ea53e49fbeb8cd284 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:23.045666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:23.135888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:23.166629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bc52e-232d-44a1-801a-979d5d3887de None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:23.209202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae0ba19-16ea-4c3b-8b36-45fb3b91e031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:23.210082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ba19-16ea-4c3b-8b36-45fb3b91e031 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:23.210373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ba19-16ea-4c3b-8b36-45fb3b91e031 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:23.210657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae0ba19-16ea-4c3b-8b36-45fb3b91e031 None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:23.211965 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0ba19-16ea-4c3b-8b36-45fb3b91e031 None admin] RBAC: Authorizing `identity:get_project(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:23.213495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae0ba19-16ea-4c3b-8b36-45fb3b91e031 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:23.215306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 567/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:23 2022] GET /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:23.222965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:23.305520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:23.376331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b1a5f8-078e-4bf6-8d3d-d190dd73f287 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:23.416942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c744bae7-aaf6-472b-a5bf-002b489b6568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:23.417816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744bae7-aaf6-472b-a5bf-002b489b6568 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:23.418151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744bae7-aaf6-472b-a5bf-002b489b6568 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:23.418498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c744bae7-aaf6-472b-a5bf-002b489b6568 None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2/users/a057c2609c15452ea53e49fbeb8cd284/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:23.422071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744bae7-aaf6-472b-a5bf-002b489b6568 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2, user_id=a057c2609c15452ea53e49fbeb8cd284, role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:23.423610 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c744bae7-aaf6-472b-a5bf-002b489b6568 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:23.439863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 556/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:39:23 2022] PUT /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2/users/a057c2609c15452ea53e49fbeb8cd284/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:39:25.660068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25910e6-29c9-4aad-8443-5b282b3072b9 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:25.660658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25910e6-29c9-4aad-8443-5b282b3072b9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:25.661095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25910e6-29c9-4aad-8443-5b282b3072b9 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:25.663591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 568/1124] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:25.672494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4777b5-5c42-48cd-8500-a08d0fa5dfc6 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:25.673326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4777b5-5c42-48cd-8500-a08d0fa5dfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:25.673484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4777b5-5c42-48cd-8500-a08d0fa5dfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:25.691843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ff4777b5-5c42-48cd-8500-a08d0fa5dfc6 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:25.693149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ff4777b5-5c42-48cd-8500-a08d0fa5dfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:25.778359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 557/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:25.804853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25910e6-29c9-4aad-8443-5b282b3072b9 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:25.933677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25910e6-29c9-4aad-8443-5b282b3072b9 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:25.974883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:25.975758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:25.976044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:25.976326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] PATH_INFO: `/v3/roles/5a1732f414a34c9caf1245f5cfb8b2b5` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:25.978001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] RBAC: Authorizing `identity:get_role(role_id=5a1732f414a34c9caf1245f5cfb8b2b5)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:25.979414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:25.980917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 569/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:25 2022] GET /identity/v3/roles/5a1732f414a34c9caf1245f5cfb8b2b5 => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:25.988458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4777b5-5c42-48cd-8500-a08d0fa5dfc6 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:26.043205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:26.127472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4777b5-5c42-48cd-8500-a08d0fa5dfc6 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:26.170505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:26.171519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:26.171856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:26.172187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] PATH_INFO: `/v3/users/a057c2609c15452ea53e49fbeb8cd284` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:26.173751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] RBAC: Authorizing `identity:get_user(user_id=a057c2609c15452ea53e49fbeb8cd284)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:26.175296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:26.177144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 558/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:25 2022] GET /identity/v3/users/a057c2609c15452ea53e49fbeb8cd284 => generated 286 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:26.183419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:26.199078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:26.314500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023b3903-8acb-43aa-8ab4-c86890120032 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:26.354764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:26.355436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:26.355723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:26.356003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:26.441893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:26.443378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:26.457494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:26.563717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 570/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 12:39:26.570325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:26.703942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:26.708866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bce9939-eff8-46dc-9ea0-f2dc40b3ca1a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:26.775052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a2666c-b087-4efa-aad1-0c0e1924f6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:26.776364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2666c-b087-4efa-aad1-0c0e1924f6a5 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:26.776904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2666c-b087-4efa-aad1-0c0e1924f6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:26.777391 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a2666c-b087-4efa-aad1-0c0e1924f6a5 None admin] PATH_INFO: `/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:26.779760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2666c-b087-4efa-aad1-0c0e1924f6a5 None admin] RBAC: Authorizing `identity:get_project(project_id=9e4fec26b5cb47ff9fbfb15b4ddb15d2)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:26.782642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a2666c-b087-4efa-aad1-0c0e1924f6a5 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:26.785817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 559/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:26 2022] GET /identity/v3/projects/9e4fec26b5cb47ff9fbfb15b4ddb15d2 => generated 311 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:26.792299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:26.908010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba86569-b2e7-4fdf-a027-6d1aa2b3d05e None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:26.925739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:26.962390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bafd3d-1b2d-439d-9bdf-93986112c102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:26.963284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bafd3d-1b2d-439d-9bdf-93986112c102 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:26.963709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bafd3d-1b2d-439d-9bdf-93986112c102 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:26.964129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bafd3d-1b2d-439d-9bdf-93986112c102 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:26.965532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bafd3d-1b2d-439d-9bdf-93986112c102 None admin] RBAC: Adding query filter params (role.id=5a1732f414a34c9caf1245f5cfb8b2b5, scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2, user.id=a057c2609c15452ea53e49fbeb8cd284) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:26.966039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bafd3d-1b2d-439d-9bdf-93986112c102 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:26.967757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bafd3d-1b2d-439d-9bdf-93986112c102 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:26.977011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 571/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:26 2022] GET /identity/v3/role_assignments?user.id=a057c2609c15452ea53e49fbeb8cd284&scope.project.id=9e4fec26b5cb47ff9fbfb15b4ddb15d2&role.id=5a1732f414a34c9caf1245f5cfb8b2b5 => generated 608 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:29.186161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba73d-402a-458c-b867-7832c0115fcf None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:29.186759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba73d-402a-458c-b867-7832c0115fcf None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:29.186759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972ba73d-402a-458c-b867-7832c0115fcf None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:29.188253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 560/1131] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:29.194403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2d3c-3812-4ac0-813c-6278de0803e7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:29.194932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2d3c-3812-4ac0-813c-6278de0803e7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:29.194932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771e2d3c-3812-4ac0-813c-6278de0803e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:29.213217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-771e2d3c-3812-4ac0-813c-6278de0803e7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:29.214499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-771e2d3c-3812-4ac0-813c-6278de0803e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:29.291758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 572/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:29.317106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ba73d-402a-458c-b867-7832c0115fcf None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:29.453059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972ba73d-402a-458c-b867-7832c0115fcf None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:29.490339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e81ba5-3d1d-4a35-b754-5ed53092c43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:29.491139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e81ba5-3d1d-4a35-b754-5ed53092c43b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:29.491424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e81ba5-3d1d-4a35-b754-5ed53092c43b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:29.491701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e81ba5-3d1d-4a35-b754-5ed53092c43b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:29.492940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e81ba5-3d1d-4a35-b754-5ed53092c43b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:29.494393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e81ba5-3d1d-4a35-b754-5ed53092c43b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:29.496061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 561/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:29.506169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2d3c-3812-4ac0-813c-6278de0803e7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:29.678341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771e2d3c-3812-4ac0-813c-6278de0803e7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:29.682724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:29.726910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f244480-644a-4a24-9f4f-bad3e01848b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:29.728046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244480-644a-4a24-9f4f-bad3e01848b3 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:29.728594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244480-644a-4a24-9f4f-bad3e01848b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:29.729109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f244480-644a-4a24-9f4f-bad3e01848b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:29.730462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244480-644a-4a24-9f4f-bad3e01848b3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:29.733779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f244480-644a-4a24-9f4f-bad3e01848b3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:29.773731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 573/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:39:29 2022] POST /identity/v3/projects => generated 311 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:39:32.136600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574e47-c7a2-4a56-bfc0-aaff0c263414 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:32.137266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574e47-c7a2-4a56-bfc0-aaff0c263414 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:32.137266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574e47-c7a2-4a56-bfc0-aaff0c263414 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:32.139181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 562/1135] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:32.145968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80988c1-0142-4ea1-a12e-ccd88e2f0890 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:32.146668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80988c1-0142-4ea1-a12e-ccd88e2f0890 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:32.146668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80988c1-0142-4ea1-a12e-ccd88e2f0890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:32.166630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-b80988c1-0142-4ea1-a12e-ccd88e2f0890 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:32.167884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b80988c1-0142-4ea1-a12e-ccd88e2f0890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:32.257982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 574/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:32.288145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574e47-c7a2-4a56-bfc0-aaff0c263414 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:32.348471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:32.487089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574e47-c7a2-4a56-bfc0-aaff0c263414 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:32.530635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe18e23-c8f5-40db-8617-2d0339768c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:32.531454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18e23-c8f5-40db-8617-2d0339768c9d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:32.531853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18e23-c8f5-40db-8617-2d0339768c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:32.532141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe18e23-c8f5-40db-8617-2d0339768c9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:32.533514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe18e23-c8f5-40db-8617-2d0339768c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:32.534975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe18e23-c8f5-40db-8617-2d0339768c9d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:32.536662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 563/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:39:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:32.543921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80988c1-0142-4ea1-a12e-ccd88e2f0890 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:32.635941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:32.653572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80988c1-0142-4ea1-a12e-ccd88e2f0890 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:32.689443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4dab30-7d6b-4f23-8d82-f190ce5397a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:32.690129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dab30-7d6b-4f23-8d82-f190ce5397a9 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:32.690418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dab30-7d6b-4f23-8d82-f190ce5397a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:32.690700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4dab30-7d6b-4f23-8d82-f190ce5397a9 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:32.691442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dab30-7d6b-4f23-8d82-f190ce5397a9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:32.693037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4dab30-7d6b-4f23-8d82-f190ce5397a9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:32.718212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 575/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:39:32 2022] POST /identity/v3/users => generated 286 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:39:34.938360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9fb2b-9745-471a-ac57-fc2f614678d7 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:34.938969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9fb2b-9745-471a-ac57-fc2f614678d7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:34.938969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9fb2b-9745-471a-ac57-fc2f614678d7 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:34.940517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 564/1139] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:34.947558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd4f0-c57c-4ead-85a0-f67770c8a542 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:34.948083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd4f0-c57c-4ead-85a0-f67770c8a542 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:34.948480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9bd4f0-c57c-4ead-85a0-f67770c8a542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:34.976108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5e9bd4f0-c57c-4ead-85a0-f67770c8a542 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:34.978165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5e9bd4f0-c57c-4ead-85a0-f67770c8a542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:35.084094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 576/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:35.110006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9fb2b-9745-471a-ac57-fc2f614678d7 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:35.229590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9fb2b-9745-471a-ac57-fc2f614678d7 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:35.231339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:35.272339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:35.273372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:35.273759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:35.274192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:35.286671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:35.294797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:35.296218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:35.297363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 565/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:39:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:35.302412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd4f0-c57c-4ead-85a0-f67770c8a542 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:35.388611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:35.426520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9bd4f0-c57c-4ead-85a0-f67770c8a542 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:35.468249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:35.469062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:35.469351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:35.469631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:35.470413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:35.470729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:35.472153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:35.482504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 577/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:39:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:35.489067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:35.610781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d167a3-54ce-42ba-9722-fbd29e9745dd None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:35.652140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:35.653080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:35.653369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:35.653685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] PATH_INFO: `/v3/users/139e6d2a7e9d414aa2646750a4ee4358` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:35.672664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] RBAC: Authorizing `identity:get_user(user_id=139e6d2a7e9d414aa2646750a4ee4358)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:35.674306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:35.676140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 566/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:35 2022] GET /identity/v3/users/139e6d2a7e9d414aa2646750a4ee4358 => generated 286 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:35.682517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:35.806788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca9b49a-cb3a-4c6b-9af8-ecb349db9600 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:35.855733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:35.856435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:35.857267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:35.857652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:35.861571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:35.954128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:35.955624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:36.069920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 578/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 30 12:39:36.076081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:36.100537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:36.192111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31b74-dda0-4013-8b53-99cda2559045 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:36.234631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac022b3e-dbf5-4d67-8f2a-3e48921add91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:36.235510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022b3e-dbf5-4d67-8f2a-3e48921add91 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:36.235799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022b3e-dbf5-4d67-8f2a-3e48921add91 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:36.236078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac022b3e-dbf5-4d67-8f2a-3e48921add91 None admin] PATH_INFO: `/v3/projects/331ae810401d4c678641b98613be160c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:36.237458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022b3e-dbf5-4d67-8f2a-3e48921add91 None admin] RBAC: Authorizing `identity:get_project(project_id=331ae810401d4c678641b98613be160c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:36.238962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac022b3e-dbf5-4d67-8f2a-3e48921add91 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:36.240928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 567/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:36 2022] GET /identity/v3/projects/331ae810401d4c678641b98613be160c => generated 311 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:36.248040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:36.287932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:36.366218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56984cda-7231-48b4-994a-ca8da8029f3a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:36.406650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cc817-cec9-4ad7-acf8-6b2011ad1347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:36.407387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cc817-cec9-4ad7-acf8-6b2011ad1347 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:36.407669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cc817-cec9-4ad7-acf8-6b2011ad1347 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:36.407943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cc817-cec9-4ad7-acf8-6b2011ad1347 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:36.408834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cc817-cec9-4ad7-acf8-6b2011ad1347 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=331ae810401d4c678641b98613be160c, user.id=139e6d2a7e9d414aa2646750a4ee4358) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:36.409147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cc817-cec9-4ad7-acf8-6b2011ad1347 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:36.410596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cc817-cec9-4ad7-acf8-6b2011ad1347 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:36.417370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 579/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:36 2022] GET /identity/v3/role_assignments?user.id=139e6d2a7e9d414aa2646750a4ee4358&scope.project.id=331ae810401d4c678641b98613be160c&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:38.530120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bedb4-7cac-4697-8de7-f94e333d0480 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:38.530714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bedb4-7cac-4697-8de7-f94e333d0480 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:38.530894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903bedb4-7cac-4697-8de7-f94e333d0480 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:38.532580 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 568/1147] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:38.538794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d7169-1444-49df-8ea2-f83d0d84665d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:38.539314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d7169-1444-49df-8ea2-f83d0d84665d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:38.539427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d7169-1444-49df-8ea2-f83d0d84665d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:38.558122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-ca7d7169-1444-49df-8ea2-f83d0d84665d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:38.559342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ca7d7169-1444-49df-8ea2-f83d0d84665d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:38.639498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 580/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:38.663893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bedb4-7cac-4697-8de7-f94e333d0480 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:38.805186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:38.822484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903bedb4-7cac-4697-8de7-f94e333d0480 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:38.864242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:38.865086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:38.865376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:38.865658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:38.879442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:38.887501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:38.888789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:38.895277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 569/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:38.896616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d7169-1444-49df-8ea2-f83d0d84665d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:38.927754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:39.041199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d7169-1444-49df-8ea2-f83d0d84665d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:39.107748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:39.108863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:39.109376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:39.109878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:39.111256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:39.111812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:39.114428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:39.130723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 581/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:39.136822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:39.260928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf87d9d-b2f5-4814-8f7e-daa85fc89154 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:39.298451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:39.299457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:39.299746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:39.300032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] PATH_INFO: `/v3/users/139e6d2a7e9d414aa2646750a4ee4358` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:39.301636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] RBAC: Authorizing `identity:get_user(user_id=139e6d2a7e9d414aa2646750a4ee4358)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:39.303349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:39.305176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 570/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:39 2022] GET /identity/v3/users/139e6d2a7e9d414aa2646750a4ee4358 => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:39.315243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:39.438807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:39.449669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850b812c-52f6-4be0-adab-5b10aa0f1241 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:39.487128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf27212-c62f-4c64-a95e-1501b32841ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:39.487994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf27212-c62f-4c64-a95e-1501b32841ec None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:39.488281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf27212-c62f-4c64-a95e-1501b32841ec None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:39.488582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf27212-c62f-4c64-a95e-1501b32841ec None admin] PATH_INFO: `/v3/projects/331ae810401d4c678641b98613be160c` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:39.489795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf27212-c62f-4c64-a95e-1501b32841ec None admin] RBAC: Authorizing `identity:get_project(project_id=331ae810401d4c678641b98613be160c)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:39.491237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf27212-c62f-4c64-a95e-1501b32841ec None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:39.493002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 582/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:39 2022] GET /identity/v3/projects/331ae810401d4c678641b98613be160c => generated 311 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:39.499369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:39.520602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:39.609921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a567f5f-ed24-4c56-8ce0-4b0dded64129 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:39.646115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f024c7dc-f4c9-4055-b641-1c9fb833f8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:39.647005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c7dc-f4c9-4055-b641-1c9fb833f8d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:39.647286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c7dc-f4c9-4055-b641-1c9fb833f8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:39.647563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f024c7dc-f4c9-4055-b641-1c9fb833f8d1 None admin] PATH_INFO: `/v3/projects/331ae810401d4c678641b98613be160c/users/139e6d2a7e9d414aa2646750a4ee4358/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:39.649594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024c7dc-f4c9-4055-b641-1c9fb833f8d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=331ae810401d4c678641b98613be160c, user_id=139e6d2a7e9d414aa2646750a4ee4358, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:39.651058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f024c7dc-f4c9-4055-b641-1c9fb833f8d1 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:39.667399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 571/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:39:39 2022] PUT /identity/v3/projects/331ae810401d4c678641b98613be160c/users/139e6d2a7e9d414aa2646750a4ee4358/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:39:41.753442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560968a-15b7-44f3-a231-6c1614b67698 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:41.753979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560968a-15b7-44f3-a231-6c1614b67698 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:41.753979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9560968a-15b7-44f3-a231-6c1614b67698 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:41.755352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 583/1154] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:41.761599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5462b-ad09-4599-8c7b-614c3be6708d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:41.762100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5462b-ad09-4599-8c7b-614c3be6708d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:41.762224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5462b-ad09-4599-8c7b-614c3be6708d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:41.783507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a6c5462b-ad09-4599-8c7b-614c3be6708d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:41.784850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a6c5462b-ad09-4599-8c7b-614c3be6708d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:41.860598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 572/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:41.887801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560968a-15b7-44f3-a231-6c1614b67698 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:42.005471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9560968a-15b7-44f3-a231-6c1614b67698 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:42.041578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:42.042376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:42.042665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:42.042944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:42.055410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:42.063995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:42.065142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:42.066020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 584/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:39:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:42.072030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5462b-ad09-4599-8c7b-614c3be6708d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:42.081412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:42.180269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5462b-ad09-4599-8c7b-614c3be6708d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:42.216071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:42.216738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:42.217032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:42.217318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:42.218080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:42.218395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:42.219794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:42.228711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 573/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:42.235185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:42.258028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:42.347734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b333e-27bc-45f2-90f0-c6d5ce740c5d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:42.387028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:42.389011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:42.389302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:42.389584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] PATH_INFO: `/v3/users/139e6d2a7e9d414aa2646750a4ee4358` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:42.390823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] RBAC: Authorizing `identity:get_user(user_id=139e6d2a7e9d414aa2646750a4ee4358)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:42.392551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:42.394181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 585/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:42 2022] GET /identity/v3/users/139e6d2a7e9d414aa2646750a4ee4358 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:42.400338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:42.476945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:42.511527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7e4f61-58eb-4456-8917-1c2d4255291b None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:42.550474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:42.551135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:42.551421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:42.551699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:42.626194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:42.627672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:42.701809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:42.746811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 574/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:42.754071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:42.848735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:42.864535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee66d1b-c79a-4e2c-81a8-ccf64c973c3d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:42.909403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509dcb1-0fec-4536-9b8f-980aa4b2f9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:42.910289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509dcb1-0fec-4536-9b8f-980aa4b2f9cc None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:42.910577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509dcb1-0fec-4536-9b8f-980aa4b2f9cc None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:42.910857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509dcb1-0fec-4536-9b8f-980aa4b2f9cc None admin] PATH_INFO: `/v3/projects/331ae810401d4c678641b98613be160c` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:42.912928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509dcb1-0fec-4536-9b8f-980aa4b2f9cc None admin] RBAC: Authorizing `identity:get_project(project_id=331ae810401d4c678641b98613be160c)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:42.914387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509dcb1-0fec-4536-9b8f-980aa4b2f9cc None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:42.920302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 586/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:42 2022] GET /identity/v3/projects/331ae810401d4c678641b98613be160c => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:42.927169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:43.047199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e2a2d-5678-4f35-be36-8a0cfbe3553d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:43.083788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39818e1-faab-4201-9ee5-794293a01213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:43.084468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39818e1-faab-4201-9ee5-794293a01213 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:43.084758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39818e1-faab-4201-9ee5-794293a01213 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:43.085037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39818e1-faab-4201-9ee5-794293a01213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:43.085883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39818e1-faab-4201-9ee5-794293a01213 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=331ae810401d4c678641b98613be160c, user.id=139e6d2a7e9d414aa2646750a4ee4358) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:43.086198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39818e1-faab-4201-9ee5-794293a01213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:43.087647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39818e1-faab-4201-9ee5-794293a01213 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:43.094126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 575/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:42 2022] GET /identity/v3/role_assignments?user.id=139e6d2a7e9d414aa2646750a4ee4358&scope.project.id=331ae810401d4c678641b98613be160c&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:45.184340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad674e5-c16d-4995-b0c7-5bee1ce1db2a None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:45.185082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad674e5-c16d-4995-b0c7-5bee1ce1db2a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:45.185082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad674e5-c16d-4995-b0c7-5bee1ce1db2a None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:45.187592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 587/1162] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:45.197015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521936-10d9-44ab-bea9-64c045127e61 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:45.197587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521936-10d9-44ab-bea9-64c045127e61 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:45.197587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b521936-10d9-44ab-bea9-64c045127e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:45.217072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-8b521936-10d9-44ab-bea9-64c045127e61 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:45.218381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8b521936-10d9-44ab-bea9-64c045127e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:45.251671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:45.298771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 576/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:45.322256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad674e5-c16d-4995-b0c7-5bee1ce1db2a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:45.443364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad674e5-c16d-4995-b0c7-5bee1ce1db2a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:45.479993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:45.480673 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:45.480961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:45.481746 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:45.508579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:45.560696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:45.562352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:45.671933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 588/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:45.678561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b521936-10d9-44ab-bea9-64c045127e61 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:45.798172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b521936-10d9-44ab-bea9-64c045127e61 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:45.835910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352c9f3-1511-46d7-b7d9-8a8250c64046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:45.836757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c9f3-1511-46d7-b7d9-8a8250c64046 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:45.837051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c9f3-1511-46d7-b7d9-8a8250c64046 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:45.837335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352c9f3-1511-46d7-b7d9-8a8250c64046 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:45.845054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352c9f3-1511-46d7-b7d9-8a8250c64046 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:45.846522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352c9f3-1511-46d7-b7d9-8a8250c64046 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a352c9f3-1511-46d7-b7d9-8a8250c64046 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:45.862309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:45.863732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:39:45.865031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 577/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:39:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:39:45.869800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:45.931873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:45.987056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d7e6d9-b6a1-4057-848a-fd6d8271a7ac None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:46.027082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04634e91-aa07-47f6-95e6-154820d5a259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:46.027758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634e91-aa07-47f6-95e6-154820d5a259 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:46.028623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634e91-aa07-47f6-95e6-154820d5a259 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:46.028995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04634e91-aa07-47f6-95e6-154820d5a259 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:46.029631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634e91-aa07-47f6-95e6-154820d5a259 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:46.029952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634e91-aa07-47f6-95e6-154820d5a259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:46.031376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04634e91-aa07-47f6-95e6-154820d5a259 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:46.040473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 589/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Thu Jun 30 12:39:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:48.265546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd38d9-417e-430c-bd3c-288ff515fec6 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:48.266121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd38d9-417e-430c-bd3c-288ff515fec6 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:48.266121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd38d9-417e-430c-bd3c-288ff515fec6 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:48.267761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 578/1167] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:48.273754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439958b-f7ff-4131-ac2c-8137be3d3de4 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:48.274239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439958b-f7ff-4131-ac2c-8137be3d3de4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:48.274387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439958b-f7ff-4131-ac2c-8137be3d3de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:48.293891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3439958b-f7ff-4131-ac2c-8137be3d3de4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:48.295926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3439958b-f7ff-4131-ac2c-8137be3d3de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:48.374329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 590/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:48.398952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd38d9-417e-430c-bd3c-288ff515fec6 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:48.439584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:48.534428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd38d9-417e-430c-bd3c-288ff515fec6 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:48.583081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46029d5-a8d9-45e2-bed3-60ce8ee05f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:48.583771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46029d5-a8d9-45e2-bed3-60ce8ee05f15 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:48.584063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46029d5-a8d9-45e2-bed3-60ce8ee05f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:48.584346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46029d5-a8d9-45e2-bed3-60ce8ee05f15 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:48.585202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46029d5-a8d9-45e2-bed3-60ce8ee05f15 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:48.586676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46029d5-a8d9-45e2-bed3-60ce8ee05f15 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:48.604236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 579/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Thu Jun 30 12:39:48 2022] POST /identity/v3/domains => generated 267 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:39:50.957306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854c24-2f31-42c9-824b-df00e0a19854 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:50.958065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854c24-2f31-42c9-824b-df00e0a19854 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:50.958065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0854c24-2f31-42c9-824b-df00e0a19854 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:50.959341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 591/1170] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:39:50.965559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e16b-4b5a-49f7-8a9f-b39189d55001 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:50.966483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e16b-4b5a-49f7-8a9f-b39189d55001 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:50.966798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1962e16b-4b5a-49f7-8a9f-b39189d55001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:50.986407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1962e16b-4b5a-49f7-8a9f-b39189d55001 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:50.987765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1962e16b-4b5a-49f7-8a9f-b39189d55001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:51.072565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 580/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:39:51.097983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854c24-2f31-42c9-824b-df00e0a19854 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:51.157834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:51.219080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0854c24-2f31-42c9-824b-df00e0a19854 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:51.261282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c99ff-2720-4e6f-808f-e67ed6150286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:51.263043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c99ff-2720-4e6f-808f-e67ed6150286 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:51.263265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c99ff-2720-4e6f-808f-e67ed6150286 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:51.263572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c99ff-2720-4e6f-808f-e67ed6150286 None admin] PATH_INFO: `/v3/domains/203f3228613941fba8d5fd97fff351cb` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:51.276639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c99ff-2720-4e6f-808f-e67ed6150286 None admin] RBAC: Authorizing `identity:get_domain(domain_id=203f3228613941fba8d5fd97fff351cb)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:51.278298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905c99ff-2720-4e6f-808f-e67ed6150286 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:51.280293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 592/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jun 30 12:39:51 2022] GET /identity/v3/domains/203f3228613941fba8d5fd97fff351cb => generated 267 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:51.287360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e16b-4b5a-49f7-8a9f-b39189d55001 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:51.302882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:51.410275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1962e16b-4b5a-49f7-8a9f-b39189d55001 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:51.455598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff31cf-24bc-422e-a98d-d622e640cacb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:51.456281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff31cf-24bc-422e-a98d-d622e640cacb None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:51.456598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff31cf-24bc-422e-a98d-d622e640cacb None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:51.456882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff31cf-24bc-422e-a98d-d622e640cacb None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:51.457615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff31cf-24bc-422e-a98d-d622e640cacb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:51.459353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff31cf-24bc-422e-a98d-d622e640cacb None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:51.491390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 581/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:39:51 2022] POST /identity/v3/projects => generated 361 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:39:53.704718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b2cd-c088-4b74-a466-54cad158af31 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:53.705332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b2cd-c088-4b74-a466-54cad158af31 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:53.705332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80b2cd-c088-4b74-a466-54cad158af31 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:53.706656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 593/1174] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:53.712372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc250-a69b-4d25-ac5c-98f199f0def1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:53.712930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc250-a69b-4d25-ac5c-98f199f0def1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:53.712930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1cc250-a69b-4d25-ac5c-98f199f0def1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:53.729891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-be1cc250-a69b-4d25-ac5c-98f199f0def1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:53.731606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-be1cc250-a69b-4d25-ac5c-98f199f0def1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:53.795890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:53.805522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 582/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:53.832175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80b2cd-c088-4b74-a466-54cad158af31 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:53.946286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80b2cd-c088-4b74-a466-54cad158af31 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:53.957661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:53.988087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782e4fa-2a81-4792-8a3d-7c5a5ca7bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:53.989010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782e4fa-2a81-4792-8a3d-7c5a5ca7bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:53.989299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782e4fa-2a81-4792-8a3d-7c5a5ca7bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:53.989580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782e4fa-2a81-4792-8a3d-7c5a5ca7bfa1 None admin] PATH_INFO: `/v3/domains/203f3228613941fba8d5fd97fff351cb` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:53.991012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782e4fa-2a81-4792-8a3d-7c5a5ca7bfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=203f3228613941fba8d5fd97fff351cb)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:53.992619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782e4fa-2a81-4792-8a3d-7c5a5ca7bfa1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:53.994315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 594/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Thu Jun 30 12:39:53 2022] GET /identity/v3/domains/203f3228613941fba8d5fd97fff351cb => generated 267 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:54.001852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cc250-a69b-4d25-ac5c-98f199f0def1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:54.158071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1cc250-a69b-4d25-ac5c-98f199f0def1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:54.203564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7ff5c-1b35-4c00-adfb-9c032a55903d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:54.204215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ff5c-1b35-4c00-adfb-9c032a55903d None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:54.204598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ff5c-1b35-4c00-adfb-9c032a55903d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:54.204928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7ff5c-1b35-4c00-adfb-9c032a55903d None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:54.205730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7ff5c-1b35-4c00-adfb-9c032a55903d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:54.207240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c7ff5c-1b35-4c00-adfb-9c032a55903d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:54.228876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 583/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:39:54 2022] POST /identity/v3/users => generated 311 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:39:56.462343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070977fa-47bb-408f-9beb-0e53e26a6d7d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:56.462936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070977fa-47bb-408f-9beb-0e53e26a6d7d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:56.463084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070977fa-47bb-408f-9beb-0e53e26a6d7d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:56.464516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 595/1178] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:39:56.471314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bf312-85e5-4833-ac66-926f8f724852 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:56.471880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bf312-85e5-4833-ac66-926f8f724852 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:56.471880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6bf312-85e5-4833-ac66-926f8f724852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:56.494766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-bb6bf312-85e5-4833-ac66-926f8f724852 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:39:56.496013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bb6bf312-85e5-4833-ac66-926f8f724852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:39:56.555800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:56.581660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 584/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:39:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:39:56.608761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070977fa-47bb-408f-9beb-0e53e26a6d7d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:56.727884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070977fa-47bb-408f-9beb-0e53e26a6d7d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:56.768522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:56.769337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:56.769623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:56.769901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:56.783512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:39:56.791652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:39:56.793875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:39:56.794984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 596/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:39:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:39:56.800308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bf312-85e5-4833-ac66-926f8f724852 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:56.913002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6bf312-85e5-4833-ac66-926f8f724852 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:56.955961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:56.956699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:56.956991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:56.957276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:56.958046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:56.958363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:56.959776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:56.969356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 585/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:39:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:39:56.978280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:57.022792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:57.099071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8f09-eafa-4f2d-98a3-52ca7ce60661 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:57.138226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:57.139127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:57.139415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:57.139698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] PATH_INFO: `/v3/users/13949876a8414eb09472dff3e98564d1` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:57.156036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] RBAC: Authorizing `identity:get_user(user_id=13949876a8414eb09472dff3e98564d1)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:57.157569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:57.159413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 597/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:39:56 2022] GET /identity/v3/users/13949876a8414eb09472dff3e98564d1 => generated 311 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:57.166371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:57.245759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:57.357095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf148277-8d3a-482e-be91-284cb806fbbe None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:57.395262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:57.395929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:57.396222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:57.396533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:57.475744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:57.477471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:57.523175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:57.585228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 586/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:39:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:39:57.592282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:57.693622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:39:57.702233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7fe99e-a74f-4a1e-8868-7da4c5d5ca8d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:57.740276 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29eef6-9fbb-402c-9ecb-8bf953a1e10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:57.741176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29eef6-9fbb-402c-9ecb-8bf953a1e10b None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:57.741467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29eef6-9fbb-402c-9ecb-8bf953a1e10b None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:57.741751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29eef6-9fbb-402c-9ecb-8bf953a1e10b None admin] PATH_INFO: `/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:57.742992 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29eef6-9fbb-402c-9ecb-8bf953a1e10b None admin] RBAC: Authorizing `identity:get_project(project_id=85d5266c9bf44ba4a4ed3b68353ecfb7)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:57.744473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29eef6-9fbb-402c-9ecb-8bf953a1e10b None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:57.746203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 598/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:39:57 2022] GET /identity/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7 => generated 361 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:39:57.753125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:39:57.869711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939f9a-c86d-4e2c-9744-d4d5ef09e871 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:39:57.916241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f1c9f1-206d-4c70-8785-81d8af92e7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:39:57.916988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c9f1-206d-4c70-8785-81d8af92e7ff None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:39:57.917317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c9f1-206d-4c70-8785-81d8af92e7ff None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:39:57.917600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f1c9f1-206d-4c70-8785-81d8af92e7ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:39:57.919152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1c9f1-206d-4c70-8785-81d8af92e7ff None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=85d5266c9bf44ba4a4ed3b68353ecfb7, user.id=13949876a8414eb09472dff3e98564d1) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:39:57.919471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1c9f1-206d-4c70-8785-81d8af92e7ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:39:57.920987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f1c9f1-206d-4c70-8785-81d8af92e7ff None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:39:57.927310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 587/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:39:57 2022] GET /identity/v3/role_assignments?user.id=13949876a8414eb09472dff3e98564d1&scope.project.id=85d5266c9bf44ba4a4ed3b68353ecfb7&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:40:00.093636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ffa5-c9e3-4f7a-9be0-e4124525272f None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:00.094236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ffa5-c9e3-4f7a-9be0-e4124525272f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:00.094615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1ffa5-c9e3-4f7a-9be0-e4124525272f None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:00.097640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 599/1186] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:40:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:40:00.104036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31503-402f-4d7e-84ed-66bcf74ee2c5 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:00.104764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31503-402f-4d7e-84ed-66bcf74ee2c5 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:00.104764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e31503-402f-4d7e-84ed-66bcf74ee2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:00.118675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:00.126186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c9e31503-402f-4d7e-84ed-66bcf74ee2c5 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:40:00.127438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c9e31503-402f-4d7e-84ed-66bcf74ee2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:40:00.208111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 588/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:40:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:40:00.233422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1ffa5-c9e3-4f7a-9be0-e4124525272f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:00.357927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1ffa5-c9e3-4f7a-9be0-e4124525272f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:00.396914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:00.397720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:00.398006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:00.398285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:00.412907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:40:00.427471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:40:00.428741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:40:00.429771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 600/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:40:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:40:00.437363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e31503-402f-4d7e-84ed-66bcf74ee2c5 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:00.549724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e31503-402f-4d7e-84ed-66bcf74ee2c5 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:00.587704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:00.588409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:00.588702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:00.588986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:00.589756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:40:00.590756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:00.592204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:00.594854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:00.603097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 589/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:40:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:40:00.609761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:00.638885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:00.735918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903bdaf-e6a4-4bf8-8894-f805f3e13ce3 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:00.776060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:00.776990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:00.777308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:00.777633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] PATH_INFO: `/v3/users/13949876a8414eb09472dff3e98564d1` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:00.779090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] RBAC: Authorizing `identity:get_user(user_id=13949876a8414eb09472dff3e98564d1)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:00.780602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:00.782334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 601/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:40:00 2022] GET /identity/v3/users/13949876a8414eb09472dff3e98564d1 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:40:00.788999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:00.919754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da549369-33e7-4f86-817a-eb7c48de45af None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:00.959489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b2538-4028-498f-923b-feac459578af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:00.960359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2538-4028-498f-923b-feac459578af None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:00.960686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2538-4028-498f-923b-feac459578af None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:00.960969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b2538-4028-498f-923b-feac459578af None admin] PATH_INFO: `/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:00.962251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b2538-4028-498f-923b-feac459578af None admin] RBAC: Authorizing `identity:get_project(project_id=85d5266c9bf44ba4a4ed3b68353ecfb7)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:00.963737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b2538-4028-498f-923b-feac459578af None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:00.966951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 590/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:40:00 2022] GET /identity/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7 => generated 361 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:40:00.976598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:01.085524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:01.096988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c0929a-32b1-4d08-aad0-d7ade200488c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:01.135964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1752f098-3a81-4e0a-9e2e-7a91b7728e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:01.137485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f098-3a81-4e0a-9e2e-7a91b7728e32 None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:01.137779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f098-3a81-4e0a-9e2e-7a91b7728e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:01.138064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752f098-3a81-4e0a-9e2e-7a91b7728e32 None admin] PATH_INFO: `/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7/users/13949876a8414eb09472dff3e98564d1/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:01.140372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f098-3a81-4e0a-9e2e-7a91b7728e32 None admin] RBAC: Authorizing `identity:create_grant(project_id=85d5266c9bf44ba4a4ed3b68353ecfb7, user_id=13949876a8414eb09472dff3e98564d1, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:01.141879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1752f098-3a81-4e0a-9e2e-7a91b7728e32 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:01.158734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 602/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:40:00 2022] PUT /identity/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7/users/13949876a8414eb09472dff3e98564d1/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:40:03.414261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345a2a9-b3c7-4ad0-9728-75c6faf46878 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:03.415072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345a2a9-b3c7-4ad0-9728-75c6faf46878 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:03.415072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2345a2a9-b3c7-4ad0-9728-75c6faf46878 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:03.416373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 591/1193] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:40:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:40:03.423804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b90b-4cdb-4fb9-87fb-396fd2655186 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:03.424415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b90b-4cdb-4fb9-87fb-396fd2655186 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:03.424415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9b90b-4cdb-4fb9-87fb-396fd2655186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:03.443043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-76d9b90b-4cdb-4fb9-87fb-396fd2655186 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:40:03.444277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-76d9b90b-4cdb-4fb9-87fb-396fd2655186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:40:03.530994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 603/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:40:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:40:03.556615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345a2a9-b3c7-4ad0-9728-75c6faf46878 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:03.638748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:03.683589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2345a2a9-b3c7-4ad0-9728-75c6faf46878 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:03.725916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:03.726730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:03.727022 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:03.727306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:03.739549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:40:03.748127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:40:03.749377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:40:03.750440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:40:03.752651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 592/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:40:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:40:03.758381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b90b-4cdb-4fb9-87fb-396fd2655186 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:03.872107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:03.899686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9b90b-4cdb-4fb9-87fb-396fd2655186 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:03.940982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:03.941579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:03.941866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:03.942147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:03.942924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:40:03.943237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:03.944688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:03.954429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 604/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:40:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:40:03.963261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:04.082440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65013674-9cf9-41f8-b9d4-799a9c1fa773 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:04.115164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:04.127164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:04.128074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:04.128365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:04.128685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] PATH_INFO: `/v3/users/13949876a8414eb09472dff3e98564d1` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:04.130102 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] RBAC: Authorizing `identity:get_user(user_id=13949876a8414eb09472dff3e98564d1)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:04.131623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:04.133459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 593/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Thu Jun 30 12:40:03 2022] GET /identity/v3/users/13949876a8414eb09472dff3e98564d1 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:40:04.140288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:04.274483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d374679f-a535-4841-92f8-7a2d0a5cd926 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:04.318149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:04.318821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:04.319109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:04.319390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:04.333643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:04.409942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:04.411414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:04.529944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 605/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:40:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:40:04.536410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:04.658573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d226f-d5e8-4fd9-814a-0870fac6998d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:04.698993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fe4f4-e0e8-4f09-b887-6be140bfd313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:04.700068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe4f4-e0e8-4f09-b887-6be140bfd313 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:04.700357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe4f4-e0e8-4f09-b887-6be140bfd313 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:04.700666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fe4f4-e0e8-4f09-b887-6be140bfd313 None admin] PATH_INFO: `/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:04.701940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe4f4-e0e8-4f09-b887-6be140bfd313 None admin] RBAC: Authorizing `identity:get_project(project_id=85d5266c9bf44ba4a4ed3b68353ecfb7)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:04.703436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fe4f4-e0e8-4f09-b887-6be140bfd313 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:04.705307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 594/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Thu Jun 30 12:40:04 2022] GET /identity/v3/projects/85d5266c9bf44ba4a4ed3b68353ecfb7 => generated 361 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:40:04.715658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:40:04.765842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:04.831254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3979aa-4cbb-44fd-a166-539857a2aa09 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:40:04.870287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28116a-f80c-49e9-b6f0-ac9c0f8f1c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:40:04.870948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28116a-f80c-49e9-b6f0-ac9c0f8f1c54 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:40:04.871846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28116a-f80c-49e9-b6f0-ac9c0f8f1c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:40:04.872124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28116a-f80c-49e9-b6f0-ac9c0f8f1c54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:40:04.873007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28116a-f80c-49e9-b6f0-ac9c0f8f1c54 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=85d5266c9bf44ba4a4ed3b68353ecfb7, user.id=13949876a8414eb09472dff3e98564d1) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:40:04.873326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28116a-f80c-49e9-b6f0-ac9c0f8f1c54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:40:04.874791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28116a-f80c-49e9-b6f0-ac9c0f8f1c54 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:40:04.881870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 606/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:40:04 2022] GET /identity/v3/role_assignments?user.id=13949876a8414eb09472dff3e98564d1&scope.project.id=85d5266c9bf44ba4a4ed3b68353ecfb7&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:40:14.694135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=69 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:40:14.878533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=47 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:09.158873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37279c-575c-4ef8-89cf-ab42442b71e8 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:09.159776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37279c-575c-4ef8-89cf-ab42442b71e8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:09.159776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b37279c-575c-4ef8-89cf-ab42442b71e8 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:09.161009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 595/1201] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:09.168021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52055e3-b640-4c90-bb8a-95cd3c6347ca None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:09.169025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52055e3-b640-4c90-bb8a-95cd3c6347ca None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:09.169025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52055e3-b640-4c90-bb8a-95cd3c6347ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:09.205549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e52055e3-b640-4c90-bb8a-95cd3c6347ca None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:09.208174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e52055e3-b640-4c90-bb8a-95cd3c6347ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:09.341027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 607/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:09.374810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37279c-575c-4ef8-89cf-ab42442b71e8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:09.591059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b37279c-575c-4ef8-89cf-ab42442b71e8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:09.644318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:09.645232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:09.645577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:09.645844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:09.659010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:09.660610 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:09.698153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:09.699822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:09.700880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:09.700880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:09.700880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:09.700880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:09.700880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 596/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:09.709303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52055e3-b640-4c90-bb8a-95cd3c6347ca None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:09.909414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52055e3-b640-4c90-bb8a-95cd3c6347ca None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:09.952870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:09.959454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becdc2ea-f5cb-4171-a181-0dd6f0acc559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:09.960409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdc2ea-f5cb-4171-a181-0dd6f0acc559 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:09.960709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdc2ea-f5cb-4171-a181-0dd6f0acc559 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:09.961063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becdc2ea-f5cb-4171-a181-0dd6f0acc559 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:09.961807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdc2ea-f5cb-4171-a181-0dd6f0acc559 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:09.962170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdc2ea-f5cb-4171-a181-0dd6f0acc559 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:09.963706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becdc2ea-f5cb-4171-a181-0dd6f0acc559 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:09.983311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 608/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:09.985283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:10.077400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:10.156025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3dcd46-6885-4217-9e4c-900449212348 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:10.204261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690b2364-8efb-45e3-a8a6-52a9896b4ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:10.205323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b2364-8efb-45e3-a8a6-52a9896b4ba6 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:10.205323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b2364-8efb-45e3-a8a6-52a9896b4ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:10.205545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690b2364-8efb-45e3-a8a6-52a9896b4ba6 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:10.206131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b2364-8efb-45e3-a8a6-52a9896b4ba6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:10.207775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690b2364-8efb-45e3-a8a6-52a9896b4ba6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:10.238999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 597/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Thu Jun 30 12:41:09 2022] POST /identity/v3/users => generated 251 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:41:12.723009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0112c-c77e-4bd0-8448-b4bb09c590d5 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:12.723859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0112c-c77e-4bd0-8448-b4bb09c590d5 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:12.723859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0112c-c77e-4bd0-8448-b4bb09c590d5 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:12.725372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 609/1206] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:12.733484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27daad1-9e46-4b36-8e12-1afdc652c602 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:12.734274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27daad1-9e46-4b36-8e12-1afdc652c602 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:12.734274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27daad1-9e46-4b36-8e12-1afdc652c602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:12.758696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d27daad1-9e46-4b36-8e12-1afdc652c602 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:12.760975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d27daad1-9e46-4b36-8e12-1afdc652c602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:12.859473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 598/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:12.888041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0112c-c77e-4bd0-8448-b4bb09c590d5 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:13.069599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0112c-c77e-4bd0-8448-b4bb09c590d5 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:13.128426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:13.128426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:13.128426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:13.128426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:13.144367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:41:13.153449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:13.154663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:13.161843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 610/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:41:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:13.163422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27daad1-9e46-4b36-8e12-1afdc652c602 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:13.237581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:13.335255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27daad1-9e46-4b36-8e12-1afdc652c602 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:13.413880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:13.415371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:13.416700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:13.417171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:13.418432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:13.418914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:13.421390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:13.435296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 599/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:41:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:13.442278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:13.537618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:13.617759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa238bc2-6159-485d-a718-5b0dffcd6240 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:13.680513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:13.683167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:13.683692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:13.684140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:13.709307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:13.713180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:13.752874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:13.754348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:13.755295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:13.755295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:13.755295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:13.755295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:13.764591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 611/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:13.765626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:13.920927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:13.927728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a132cc7-0b9b-40ec-8081-5f5c041502b8 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:14.020493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:14.021661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:14.022116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:14.022550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:14.023481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:14.023832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:14.025944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:14.049438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 600/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:14.051181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:14.216314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279dea25-c941-42f8-9d6b-b2e6889133a1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:14.219978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:14.298046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:14.299042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:14.299415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:14.300188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:14.314725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:14.316862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:41:14.349459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:14.351237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:14.359913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 612/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:41:14.361723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:14.565663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4851b671-140d-4f17-92d7-6c6355dc08b6 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:14.641937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:14.643155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:14.643691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:14.644243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:14.646193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:14.646810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:14.650110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:14.700160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 601/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 30 12:41:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:14.707916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:14.891253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304f82fe-3a50-4fcd-ad5a-eebed6c030d5 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:14.942091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:14.943297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:14.943819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:14.944325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:14.987032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:15.064416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:15.067187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:15.260991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 613/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:41:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:41:15.270322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:15.313153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:15.460986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd5cec9-b9b7-455d-8515-f9422723d0ff None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:15.514869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:15.515693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:15.516086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:15.516681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:15.530443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:15.532016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:15.555921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:15.557647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:15.558628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:15.558628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:15.558628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:15.558628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:15.558953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 602/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:15.566152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:15.683267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:15.740227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643cea0b-46ff-4857-b2bf-10e42505c570 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:15.787737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:15.788787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:15.789274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:15.789773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:15.791234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:15.791776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:15.793641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:15.808635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 614/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:15.816527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:15.953758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:16.020250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f455257-b19c-4477-b866-19869e40c6e0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:16.076671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:16.077982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:16.078468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:16.078955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:16.092672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:16.095596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:41:16.123670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:16.125557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:16.127551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 603/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:41:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:16.135537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:16.310498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72172457-3718-4c91-86eb-c4c95ab182d9 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:16.338081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:16.351660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea924822-b3ce-4af4-93f9-e95783710c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:16.352412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924822-b3ce-4af4-93f9-e95783710c00 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:16.352733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924822-b3ce-4af4-93f9-e95783710c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:16.353040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea924822-b3ce-4af4-93f9-e95783710c00 None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:16.353842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924822-b3ce-4af4-93f9-e95783710c00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:16.354156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924822-b3ce-4af4-93f9-e95783710c00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:16.355611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea924822-b3ce-4af4-93f9-e95783710c00 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:16.375162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 615/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:41:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:16.377104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:16.581104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04669e04-2ed5-4279-9eec-7de00dcfed71 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:16.629174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:16.639341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1912ad-685e-472e-a983-af2fa15e8814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:16.640231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1912ad-685e-472e-a983-af2fa15e8814 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:16.640713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1912ad-685e-472e-a983-af2fa15e8814 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:16.641196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1912ad-685e-472e-a983-af2fa15e8814 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:16.642575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1912ad-685e-472e-a983-af2fa15e8814 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=fb592cacc3b1469fb6e64254f1fcf285) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:16.643083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1912ad-685e-472e-a983-af2fa15e8814 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:16.644822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1912ad-685e-472e-a983-af2fa15e8814 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:16.653334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 604/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:41:16 2022] GET /identity/v3/role_assignments?user.id=fb592cacc3b1469fb6e64254f1fcf285&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:19.667034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68b33d-78f5-4348-a671-4085921162b8 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:19.667034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68b33d-78f5-4348-a671-4085921162b8 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:19.667034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c68b33d-78f5-4348-a671-4085921162b8 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:19.669410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 616/1220] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:19.678207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcd898-39a2-4366-b101-802ae542371c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:19.679098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcd898-39a2-4366-b101-802ae542371c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:19.679240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbcd898-39a2-4366-b101-802ae542371c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:19.700650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-cbbcd898-39a2-4366-b101-802ae542371c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:19.702255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cbbcd898-39a2-4366-b101-802ae542371c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:19.812737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 605/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:19.839377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68b33d-78f5-4348-a671-4085921162b8 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:19.986574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c68b33d-78f5-4348-a671-4085921162b8 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:20.045598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:20.047011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:20.047525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:20.048041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:20.069049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:41:20.089604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:20.090764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:41:20.091718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:20.092572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 617/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:41:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:20.099974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcd898-39a2-4366-b101-802ae542371c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:20.225151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbcd898-39a2-4366-b101-802ae542371c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:20.259196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:20.273781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:20.275064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:20.275407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:20.275721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:20.276689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:20.277025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:20.278592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:20.289410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 606/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:41:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:20.298547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:20.373606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:20.456584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebe05d-f8be-4f12-a9bd-dcbdcf4785a7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:20.503647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:20.504585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:20.504874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:20.505188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:20.520720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:20.523442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:20.548723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:20.550022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:20.551795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:20.551795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:20.551795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:20.551795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:20.551795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 618/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:20.559841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:20.702325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d358454b-e783-49a6-855d-5cec0588e8aa None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:20.740907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:20.741595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:20.741931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:20.742206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:20.743055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:20.743533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:20.745184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:20.760699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 607/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:20.767383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:20.897373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:20.913878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c28ae2-5706-4f68-b4b2-3ad44a3f51ba None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:20.981160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:20.982524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:20.983022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:20.983527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:20.999079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:21.001013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:41:21.031587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:21.032910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:21.033879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:21.034425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 619/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:21.040716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:21.107091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:21.188578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56426-6a89-4cc9-8ea1-f882ae826196 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:21.244128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:21.245086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:21.245382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:21.245775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:21.247363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:21.247717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:21.250303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:21.292701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 608/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 30 12:41:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:21.299050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:21.494136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57891f1-d1d3-4b78-8f07-1d6eac020db7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:21.549038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:21.549856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:21.550141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:21.550445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:21.564707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:21.566247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:21.587498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:21.588912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:21.590016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:21.590016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:21.590016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:21.590016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:21.590016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 620/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:21.595552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:21.752744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199c0459-bcca-41f5-9cd4-ff901ea68ed0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:21.755500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:21.798011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:21.798690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:21.798981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:21.799262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:21.800094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:21.800358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:21.801857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:21.816799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 609/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:21.823335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:21.841674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:21.990643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746c0e24-89b5-4837-9ade-700fd5126b03 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:22.046466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:22.047570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:22.047973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:22.048371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:22.059351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:22.061292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:41:22.086914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:22.088987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:22.099324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 621/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:41:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:22.100449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:22.254053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc5c46-9e25-4b4e-abb9-4ba1e836f87f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:22.312489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ad1741-eda2-4624-ac72-788fc02e7a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:22.313044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1741-eda2-4624-ac72-788fc02e7a15 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:22.313329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1741-eda2-4624-ac72-788fc02e7a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:22.313608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad1741-eda2-4624-ac72-788fc02e7a15 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:22.314432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad1741-eda2-4624-ac72-788fc02e7a15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:22.314783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad1741-eda2-4624-ac72-788fc02e7a15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:22.316254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ad1741-eda2-4624-ac72-788fc02e7a15 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:22.332232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 610/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:41:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:22.339747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:22.431339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:22.494399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d332714-25da-4764-8d02-6037f8865b06 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:22.549141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48097c3c-0e38-494f-b60d-33e7408b0e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:22.550400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48097c3c-0e38-494f-b60d-33e7408b0e7a None admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:22.550824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48097c3c-0e38-494f-b60d-33e7408b0e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:22.551273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48097c3c-0e38-494f-b60d-33e7408b0e7a None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/fb592cacc3b1469fb6e64254f1fcf285/roles/9637b53466484a69b2e09ccf4a649721` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:22.576939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48097c3c-0e38-494f-b60d-33e7408b0e7a None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=fb592cacc3b1469fb6e64254f1fcf285, role_id=9637b53466484a69b2e09ccf4a649721)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:22.578409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48097c3c-0e38-494f-b60d-33e7408b0e7a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:22.598060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 622/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:41:22 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/fb592cacc3b1469fb6e64254f1fcf285/roles/9637b53466484a69b2e09ccf4a649721 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:41:25.100479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145186f8-b3f6-46c9-a102-15087a640d37 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:25.101278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145186f8-b3f6-46c9-a102-15087a640d37 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:25.101278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145186f8-b3f6-46c9-a102-15087a640d37 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:25.103355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 611/1233] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:25.109627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279196bd-55f8-479b-a51e-09cc9a6c65f0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:25.110215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279196bd-55f8-479b-a51e-09cc9a6c65f0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:25.110215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279196bd-55f8-479b-a51e-09cc9a6c65f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:25.131658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-279196bd-55f8-479b-a51e-09cc9a6c65f0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:25.135078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-279196bd-55f8-479b-a51e-09cc9a6c65f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:25.271038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 623/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 30 12:41:25.308441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145186f8-b3f6-46c9-a102-15087a640d37 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:25.349172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:25.511190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145186f8-b3f6-46c9-a102-15087a640d37 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:25.567200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:25.568177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:25.570010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:25.570410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:25.584289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:41:25.593575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:25.595903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:25.598017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 612/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Thu Jun 30 12:41:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:25.602067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279196bd-55f8-479b-a51e-09cc9a6c65f0 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:25.698164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:25.776149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279196bd-55f8-479b-a51e-09cc9a6c65f0 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:25.843229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:25.844439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:25.844944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:25.845429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:25.846890 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:25.847419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:25.850105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:25.868087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 624/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Thu Jun 30 12:41:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:25.874273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:25.985243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:26.005495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89f5db6-d7f7-4371-88bc-c9b3dcdc11b0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:26.046902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:26.047597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:26.047886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:26.048167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:26.061362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:26.062890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:26.096521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:26.098216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:26.099483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:26.099483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:26.099483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:26.099483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:26.099483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 613/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:26.108818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:26.304779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02020181-c5e8-47dd-b3ad-c13b04dbbaa2 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:26.326012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:26.356059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:26.356786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:26.357088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:26.357413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:26.358230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:26.358575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:26.360221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:26.377436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 625/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:26.384265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:26.548322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d52151c-0fe7-4aad-b295-b8fc1761ed49 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:26.596982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:26.598290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:26.598729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:26.599095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:26.603916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:26.611303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:26.613239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:41:26.634302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:26.636414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:26.638298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 614/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:26.645190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:26.846365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83074c33-93e3-4785-a95a-b7e298e0eb90 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:26.915808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:26.916619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:26.917030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:26.917693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:26.919316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:26.919947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:26.925547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:26.953294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 626/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 30 12:41:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:26.962964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:27.106951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd496f-ba9a-42d8-a747-50dddc87aeb3 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:27.148085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:27.149596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:27.149833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:27.150106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:27.238149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:27.249965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:27.252187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:27.423111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 615/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:41:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:41:27.425289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:27.482887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:27.628880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3edcec4-c3b4-4324-8c8c-7cd9f84a4111 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:27.689830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:27.690725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:27.691016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:27.691295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:27.706901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:27.706901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:27.745007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:27.746875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:27.748692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:27.748692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:27.748692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:27.748692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:27.748692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 627/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:27.755656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:27.897478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:27.908327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6645c15-26a9-47cd-94c2-14f6621a4d05 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:27.964719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:27.965573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:27.965965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:27.966395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:27.967690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:27.968227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:27.970401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:27.986678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 616/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:27.994700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:28.130315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:28.163323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5a4430-dee0-4718-b1b6-60da0fffb06a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:28.219493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:28.220785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:28.221288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:28.221786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:28.235397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:28.238724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:41:28.263124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:28.265187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:28.266837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 628/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:41:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:28.277267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:28.459028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff8d9f-84c2-4f3a-97c1-cc91dcf6841c None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:28.518983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7071f8b6-16cf-4d9d-b351-a8a189a2e378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:28.519893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f8b6-16cf-4d9d-b351-a8a189a2e378 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:28.520274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f8b6-16cf-4d9d-b351-a8a189a2e378 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:28.520688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7071f8b6-16cf-4d9d-b351-a8a189a2e378 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:28.521622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f8b6-16cf-4d9d-b351-a8a189a2e378 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:28.522052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f8b6-16cf-4d9d-b351-a8a189a2e378 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:28.523729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7071f8b6-16cf-4d9d-b351-a8a189a2e378 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:28.540469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 617/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:41:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:28.548254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:28.733484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee715ff9-20e0-459d-8824-2ef4c0adcaa3 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:28.790180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604a5d0-ab33-4c62-a0a0-d019bac63c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:28.791157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604a5d0-ab33-4c62-a0a0-d019bac63c16 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:28.791461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604a5d0-ab33-4c62-a0a0-d019bac63c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:28.791737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604a5d0-ab33-4c62-a0a0-d019bac63c16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:28.792667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604a5d0-ab33-4c62-a0a0-d019bac63c16 None admin] RBAC: Adding query filter params (role.id=9637b53466484a69b2e09ccf4a649721, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=fb592cacc3b1469fb6e64254f1fcf285) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:28.793101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604a5d0-ab33-4c62-a0a0-d019bac63c16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:28.794824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604a5d0-ab33-4c62-a0a0-d019bac63c16 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:28.804669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 629/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:41:28 2022] GET /identity/v3/role_assignments?user.id=fb592cacc3b1469fb6e64254f1fcf285&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=9637b53466484a69b2e09ccf4a649721 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:31.236830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fdbfa-c909-43c0-946e-75e668e83e02 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:31.237547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fdbfa-c909-43c0-946e-75e668e83e02 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:31.237547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2fdbfa-c909-43c0-946e-75e668e83e02 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:31.238821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 618/1247] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:41:31.247368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832252e0-1c67-4c11-b322-cf011aa4041c None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:31.247998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832252e0-1c67-4c11-b322-cf011aa4041c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:31.248644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832252e0-1c67-4c11-b322-cf011aa4041c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:31.259885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:31.282868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-832252e0-1c67-4c11-b322-cf011aa4041c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:31.284976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-832252e0-1c67-4c11-b322-cf011aa4041c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:31.391048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 630/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:31.431588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fdbfa-c909-43c0-946e-75e668e83e02 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:31.455533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:31.572496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2fdbfa-c909-43c0-946e-75e668e83e02 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:31.631804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18690-5695-4658-a644-244121041789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:31.633589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18690-5695-4658-a644-244121041789 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:31.633989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18690-5695-4658-a644-244121041789 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:31.634356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c18690-5695-4658-a644-244121041789 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:31.649032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c18690-5695-4658-a644-244121041789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-52c18690-5695-4658-a644-244121041789 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:41:31.657650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:31.659665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:31.661451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 619/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:41:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 30 12:41:31.669033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832252e0-1c67-4c11-b322-cf011aa4041c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:31.818376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832252e0-1c67-4c11-b322-cf011aa4041c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:31.860034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:31.870317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:31.871684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:31.872354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:31.872983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:31.874453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:31.874785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:31.876323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:31.886366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 631/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:41:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:31.892554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18690-5695-4658-a644-244121041789 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:31.991099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:32.019099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c18690-5695-4658-a644-244121041789 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:32.063099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:32.064410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:32.064977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:32.065472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:32.082014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:32.084264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:32.112055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:32.113907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:32.114984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:32.114984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:32.114984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:32.114984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:32.114984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 620/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:32.122858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:32.269840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ba719-ed8b-470d-8af4-7cdd34d33879 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:32.327624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:32.328648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:32.329025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:32.329390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:32.330470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:32.330939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:32.333228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:32.354527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 632/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:32.363916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:32.535045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e7f23-faa0-4b70-843c-ae0c3901b8da None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:32.573638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:32.586381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:32.587866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:32.588508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:32.588952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:32.600206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:32.602681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:41:32.623178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:32.625441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:32.627646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 621/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:32.635233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:32.732932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:32.809121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e664102c-ebd1-4cb1-8d5b-a006bb374509 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:32.870846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:32.871674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:32.871957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:32.872246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:32.873279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:32.873546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:32.875044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:32.896848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 633/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 30 12:41:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:32.903006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:33.084592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878eb09a-3574-40fb-933d-2a8038457e47 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:33.125627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:33.126164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:33.126449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:33.126737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:33.203243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:33.218792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:33.220277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:33.364940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 622/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:41:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:41:33.371776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:33.520738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2e90da-a33b-4674-8111-81dc832dc86a None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:33.548117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:33.577419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:33.578296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:33.578581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:33.578881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:33.592791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:33.594377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:33.618098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:33.619951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:33.622304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:33.622304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:33.622304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:33.622304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:33.622304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 634/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:33.627986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:33.743435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:33.761811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482522cb-768c-449c-9f38-0f1d4cc010d0 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:33.807338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:33.807995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:33.808305 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:33.808640 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:33.809424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:33.809735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:33.811293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:33.826415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 623/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:33.832510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:33.978459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deb0c3-341a-4a0b-b696-e7569f469328 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:34.032343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:34.033336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:34.033664 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:34.033965 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] PATH_INFO: `/v3/projects/service` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:34.045978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:34.049188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:41:34.069099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:34.070757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:34.071782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:34.072552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 635/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:41:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:34.079972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:34.212907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13bbf99-263d-4d9f-a81d-a4691bffda99 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:34.255289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c144d9-be2f-431a-b2d2-07cc81d36077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:34.255968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c144d9-be2f-431a-b2d2-07cc81d36077 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:34.256257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c144d9-be2f-431a-b2d2-07cc81d36077 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:34.256643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c144d9-be2f-431a-b2d2-07cc81d36077 None admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:34.258120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c144d9-be2f-431a-b2d2-07cc81d36077 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:34.258679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c144d9-be2f-431a-b2d2-07cc81d36077 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:34.260318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c144d9-be2f-431a-b2d2-07cc81d36077 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:34.281240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 624/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:34.288072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:34.336230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:34.446631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263a78a6-4bb7-4504-a652-55f53a2f26da None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:34.491072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee58dbf-b39e-427a-b3f0-796e941e525a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:34.492716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58dbf-b39e-427a-b3f0-796e941e525a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:34.493140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58dbf-b39e-427a-b3f0-796e941e525a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:34.493598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee58dbf-b39e-427a-b3f0-796e941e525a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:34.495501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee58dbf-b39e-427a-b3f0-796e941e525a None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=fb592cacc3b1469fb6e64254f1fcf285) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:34.496106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee58dbf-b39e-427a-b3f0-796e941e525a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:34.499222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee58dbf-b39e-427a-b3f0-796e941e525a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:34.506966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 636/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:41:34 2022] GET /identity/v3/role_assignments?user.id=fb592cacc3b1469fb6e64254f1fcf285&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 259 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:36.721677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b36cf-c1fe-4f66-99e1-01ffb9e1515c None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:36.722232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b36cf-c1fe-4f66-99e1-01ffb9e1515c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:36.722232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90b36cf-c1fe-4f66-99e1-01ffb9e1515c None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:36.723620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 625/1261] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:36.729315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26155a6-3284-4eb8-afac-6aae53800552 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:36.730075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26155a6-3284-4eb8-afac-6aae53800552 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:36.730075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26155a6-3284-4eb8-afac-6aae53800552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:36.748233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f26155a6-3284-4eb8-afac-6aae53800552 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:36.749464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f26155a6-3284-4eb8-afac-6aae53800552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:36.822683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 637/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:36.848269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b36cf-c1fe-4f66-99e1-01ffb9e1515c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:36.860550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:36.970243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90b36cf-c1fe-4f66-99e1-01ffb9e1515c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:37.016045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:37.017160 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:37.017452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:37.017731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:37.033389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:41:37.042088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:37.043863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:37.045541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 626/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:41:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:37.050034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26155a6-3284-4eb8-afac-6aae53800552 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:37.073573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:37.175358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26155a6-3284-4eb8-afac-6aae53800552 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:37.217347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:37.218025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:37.218311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:37.218587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:37.219341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:37.219650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:37.221121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:37.230877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 638/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:41:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:37.236978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:37.337955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:37.384839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e53349-da2c-4db2-8df1-998a5fd2bcd9 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:37.428999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:37.431025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:37.431400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:37.431804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:37.443894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:37.446700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:37.466571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:37.467718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:37.468702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:37.468702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:37.468702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:37.468702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:37.468702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 627/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:37.474005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:37.575883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:37.599684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fa20b5-f1c8-42d5-b3ff-c803c7b2a4ea None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:37.638499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:37.639194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:37.639476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:37.639757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:37.640520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:37.640838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:37.642469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:37.656735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 639/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:37.662287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:37.765500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e10c48b-82dd-4515-9776-97faefdfcb3d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:37.785822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:37.800699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:37.801502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:37.801795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:37.802071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] PATH_INFO: `/v3/users/placement` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:37.810612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:37.812086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:41:37.826764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:37.827918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:37.829111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 628/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:37.834443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:37.936260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80c6ec4-b214-4093-9f60-1cd034e15187 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:37.970202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:37.970866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:37.971149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:37.971423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:37.972251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:37.972593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:37.974019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:37.982891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:37.991715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 640/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 30 12:41:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:37.997534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:38.106238 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982a9d9-91e0-4810-9bb4-5102259e7dcd None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:38.146996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:38.147808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:38.148222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:38.149092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:38.160798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:38.162298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:38.181106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:38.182249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:38.187712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:38.187712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:38.187712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:38.187712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:38.187712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 629/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:38.188869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:38.303018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb50300-6471-4478-aa91-8ed345f07d5d None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:38.339118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:38.339852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:38.340215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:38.340527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:38.341295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:38.341611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:38.342981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:38.355440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 641/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:38.361376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:38.396812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:38.494775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fb8b30-a711-4348-ba7a-0769d58cbc5a None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:38.529260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:38.530051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:38.530335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:38.530611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:38.537215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:38.538647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:41:38.552704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:38.553740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:38.555539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 630/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:38.560619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:38.619683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:38.665085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9002f1c9-5995-4413-bfb9-bf2416e1a5a4 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:38.699244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f617ea99-a3be-4a2a-9515-294b05c5a57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:38.699914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ea99-a3be-4a2a-9515-294b05c5a57a None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:38.700204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ea99-a3be-4a2a-9515-294b05c5a57a None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:38.700526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f617ea99-a3be-4a2a-9515-294b05c5a57a None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:38.701314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ea99-a3be-4a2a-9515-294b05c5a57a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:38.701632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ea99-a3be-4a2a-9515-294b05c5a57a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:38.703062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f617ea99-a3be-4a2a-9515-294b05c5a57a None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:38.715026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 642/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:38.721014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:38.814598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:38.824267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356caf4b-7ee4-4cfc-9291-fc257fff95dc None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:38.857755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afb2b91-563e-4156-b71d-5e820e706268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:38.858632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2b91-563e-4156-b71d-5e820e706268 None admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:38.858920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2b91-563e-4156-b71d-5e820e706268 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:38.859198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb2b91-563e-4156-b71d-5e820e706268 None admin] PATH_INFO: `/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/fb592cacc3b1469fb6e64254f1fcf285/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:38.861159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb2b91-563e-4156-b71d-5e820e706268 None admin] RBAC: Authorizing `identity:create_grant(project_id=8aadca03ef0a4218868f16b997ec248e, user_id=fb592cacc3b1469fb6e64254f1fcf285, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:38.862583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afb2b91-563e-4156-b71d-5e820e706268 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:38.876406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 631/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Thu Jun 30 12:41:38 2022] PUT /identity/v3/projects/8aadca03ef0a4218868f16b997ec248e/users/fb592cacc3b1469fb6e64254f1fcf285/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:41:40.975590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e228-b3a0-427c-99f7-1ae45ae7b22d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:40.976230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e228-b3a0-427c-99f7-1ae45ae7b22d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:40.976230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e228-b3a0-427c-99f7-1ae45ae7b22d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:40.977643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 643/1274] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:40.982832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109efae5-9c86-4ee5-8f75-16a6856a7913 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:40.983223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109efae5-9c86-4ee5-8f75-16a6856a7913 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:40.983406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109efae5-9c86-4ee5-8f75-16a6856a7913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:40.999876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-109efae5-9c86-4ee5-8f75-16a6856a7913 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:41.001100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-109efae5-9c86-4ee5-8f75-16a6856a7913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:41.068503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 632/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:41.094133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e228-b3a0-427c-99f7-1ae45ae7b22d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:41.201859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e228-b3a0-427c-99f7-1ae45ae7b22d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:41.222620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:41.242888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:41.243742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:41.243914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:41.244191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:41.259206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 30 12:41:41.267638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:41.269889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:41.271884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 644/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Thu Jun 30 12:41:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:41.277449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109efae5-9c86-4ee5-8f75-16a6856a7913 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:41.376994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:41.398229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109efae5-9c86-4ee5-8f75-16a6856a7913 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:41.434947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:41.435630 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:41.435920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:41.436199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:41.436991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:41.437306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:41.438683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:41.447995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 633/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Thu Jun 30 12:41:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:41.453917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:41.571645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acaeea-f889-4969-a789-e2025ee94bb7 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:41.610403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:41.611200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:41.611487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:41.611769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:41.623522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:41.625049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:41.646811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:41.648015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:41.649146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:41.649146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:41.649146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:41.649146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:41.649146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 645/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:41.653896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:41.761062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d834027-5c87-4a08-b0b2-728fddd2c803 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:41.798082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:41.798756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:41.799044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:41.799325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:41.800065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:41.800377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:41.801813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:41.815664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 634/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:41.821470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:41.855303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:41.931944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f376c0-2749-45ee-9958-1c16ce10f47c None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:41.968034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a423b-c813-4d67-af35-a188865db9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:41.968871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a423b-c813-4d67-af35-a188865db9de None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:41.969158 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a423b-c813-4d67-af35-a188865db9de None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:41.969454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a423b-c813-4d67-af35-a188865db9de None admin] PATH_INFO: `/v3/users/placement` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:41.977995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a423b-c813-4d67-af35-a188865db9de None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:41.979456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a423b-c813-4d67-af35-a188865db9de None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-207a423b-c813-4d67-af35-a188865db9de None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 30 12:41:41.994671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:41.995902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:41.997289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 646/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:42.001811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:42.005953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:42.119207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6db35ef-028a-4ad7-a3ed-68c1c504e68d None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:42.157094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:42.157800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:42.158093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:42.158379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:42.159292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:42.159615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:42.161163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:42.180707 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 635/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Thu Jun 30 12:41:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:42.186574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a423b-c813-4d67-af35-a188865db9de None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:42.294034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:42.307065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a423b-c813-4d67-af35-a188865db9de None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:42.345019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:42.345685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:42.345975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:42.346259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:42.432217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:42.433879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:42.535637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:42.546646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 647/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Thu Jun 30 12:41:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 30 12:41:42.552654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:42.618670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:42.663862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8608df-836c-4650-8164-e50ce80848b7 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:42.703093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:42.703905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:42.704192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:42.704513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:42.717742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:42.719483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 30 12:41:42.742876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:42.744074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:42.745196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 30 12:41:42.745196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 30 12:41:42.745196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 30 12:41:42.745196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:42.745196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 636/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:42.750713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:42.871000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130a7d2-9cc2-4fc2-b654-3d3d0a34d5b8 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:42.909085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:42.909888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:42.910291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:42.910605 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:42.911611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:42.911924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:42.913329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:42.927377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 648/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Thu Jun 30 12:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:41:42.934179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:43.047554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccccc9-40e7-4e2b-ad63-9af906417f7f None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:43.064219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:43.087904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:43.088744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:43.089034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:43.089318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:43.097196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:43.098675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 30 12:41:43.116511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:43.119182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: ERROR keystone.server.flask.application Jun 30 12:41:43.121323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 637/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Thu Jun 30 12:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:43.125179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:43.180601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:43.234119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548f5488-de71-4ac7-8b3c-83e861aefee1 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:43.275196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ecba6-3362-48a2-9a31-97ec95bf70cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:43.276018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ecba6-3362-48a2-9a31-97ec95bf70cd None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:43.276582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ecba6-3362-48a2-9a31-97ec95bf70cd None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:43.277082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ecba6-3362-48a2-9a31-97ec95bf70cd None admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:43.277887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ecba6-3362-48a2-9a31-97ec95bf70cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:43.278322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ecba6-3362-48a2-9a31-97ec95bf70cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:43.280681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ecba6-3362-48a2-9a31-97ec95bf70cd None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:43.301313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 649/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Thu Jun 30 12:41:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:43.308148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:43.419279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245d0aa-702b-43f9-a81f-cbda73b0d242 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:43.459873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f49fe7-03eb-4da9-ab2e-de4ccbaf0504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:43.460719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f49fe7-03eb-4da9-ab2e-de4ccbaf0504 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:43.460944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f49fe7-03eb-4da9-ab2e-de4ccbaf0504 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:43.461307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f49fe7-03eb-4da9-ab2e-de4ccbaf0504 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:43.462294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f49fe7-03eb-4da9-ab2e-de4ccbaf0504 None admin] RBAC: Adding query filter params (role.id=44959a301b01424ea68b1b0a25c1321f, scope.project.id=8aadca03ef0a4218868f16b997ec248e, user.id=fb592cacc3b1469fb6e64254f1fcf285) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:43.462641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f49fe7-03eb-4da9-ab2e-de4ccbaf0504 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:43.464188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f49fe7-03eb-4da9-ab2e-de4ccbaf0504 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:43.471394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 638/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Thu Jun 30 12:41:43 2022] GET /identity/v3/role_assignments?user.id=fb592cacc3b1469fb6e64254f1fcf285&scope.project.id=8aadca03ef0a4218868f16b997ec248e&role.id=44959a301b01424ea68b1b0a25c1321f => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:45.668884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca67-20a2-4e10-9f3f-cddbf403511d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:45.669440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca67-20a2-4e10-9f3f-cddbf403511d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:45.669440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bdca67-20a2-4e10-9f3f-cddbf403511d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:45.670818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 650/1288] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:45.676168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c9345-7cdc-4fdf-950e-d2fd56fd94ff None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:45.676599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c9345-7cdc-4fdf-950e-d2fd56fd94ff None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:45.676776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263c9345-7cdc-4fdf-950e-d2fd56fd94ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:45.694346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-263c9345-7cdc-4fdf-950e-d2fd56fd94ff None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:45.696701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-263c9345-7cdc-4fdf-950e-d2fd56fd94ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:45.729050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:45.769567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 639/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:45.792654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdca67-20a2-4e10-9f3f-cddbf403511d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:45.899719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bdca67-20a2-4e10-9f3f-cddbf403511d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:45.910519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:45.934518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:45.935250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:45.935541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:45.935818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:45.936510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:45.938165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:45.950588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:45.951943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:45.953087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 651/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:41:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:45.957860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c9345-7cdc-4fdf-950e-d2fd56fd94ff None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:46.060231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263c9345-7cdc-4fdf-950e-d2fd56fd94ff None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:46.095910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112d2ae4-ac4a-47f9-80cb-93da389ebb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:46.096608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2ae4-ac4a-47f9-80cb-93da389ebb5f None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:46.096900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2ae4-ac4a-47f9-80cb-93da389ebb5f None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:46.097184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112d2ae4-ac4a-47f9-80cb-93da389ebb5f None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:46.097899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2ae4-ac4a-47f9-80cb-93da389ebb5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:46.098215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2ae4-ac4a-47f9-80cb-93da389ebb5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:46.099617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112d2ae4-ac4a-47f9-80cb-93da389ebb5f None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:46.104755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 640/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 30 12:41:45 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:46.112532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:46.216154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e93668b-52ae-431b-815b-91123ee198a5 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:46.254150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d4dc0-e63c-4d4b-8629-e21779f51cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:46.254831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4dc0-e63c-4d4b-8629-e21779f51cfb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:46.255121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4dc0-e63c-4d4b-8629-e21779f51cfb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:46.255405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d4dc0-e63c-4d4b-8629-e21779f51cfb None admin] PATH_INFO: `/v3/services` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:46.256132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4dc0-e63c-4d4b-8629-e21779f51cfb None admin] RBAC: Adding query filter params (type=placement) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:46.256473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4dc0-e63c-4d4b-8629-e21779f51cfb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:46.257919 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d4dc0-e63c-4d4b-8629-e21779f51cfb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:46.263164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 652/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 30 12:41:46 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:48.368950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc329eb-d739-4e4e-aa2d-ff68592d8176 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:48.369503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc329eb-d739-4e4e-aa2d-ff68592d8176 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:48.369654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc329eb-d739-4e4e-aa2d-ff68592d8176 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:48.371329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 641/1293] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:48.377291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe790c-ec2c-4adc-abac-1bfd2950c7b8 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:48.377771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe790c-ec2c-4adc-abac-1bfd2950c7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:48.377864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfe790c-ec2c-4adc-abac-1bfd2950c7b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:48.395724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4dfe790c-ec2c-4adc-abac-1bfd2950c7b8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:48.396966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4dfe790c-ec2c-4adc-abac-1bfd2950c7b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:48.426123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:48.464233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 653/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:48.488755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc329eb-d739-4e4e-aa2d-ff68592d8176 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:48.521382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:48.599338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc329eb-d739-4e4e-aa2d-ff68592d8176 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:48.635700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cdbb5-293a-40ca-94d3-10d24eaf43e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:48.636296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cdbb5-293a-40ca-94d3-10d24eaf43e6 None admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:48.636617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cdbb5-293a-40ca-94d3-10d24eaf43e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:48.636904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cdbb5-293a-40ca-94d3-10d24eaf43e6 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:48.637651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cdbb5-293a-40ca-94d3-10d24eaf43e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:48.639038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cdbb5-293a-40ca-94d3-10d24eaf43e6 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:48.653916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 642/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Thu Jun 30 12:41:48 2022] POST /identity/v3/services => generated 246 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:41:50.796252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a0982-08ff-49f1-a84c-504a8a9fc557 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:50.796900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a0982-08ff-49f1-a84c-504a8a9fc557 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:50.796900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a0982-08ff-49f1-a84c-504a8a9fc557 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:50.798198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 654/1296] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:50.806828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a659ea-24fd-4b26-889c-e089b6922728 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:50.807349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a659ea-24fd-4b26-889c-e089b6922728 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:50.807647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a659ea-24fd-4b26-889c-e089b6922728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:50.824789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-72a659ea-24fd-4b26-889c-e089b6922728 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:50.825968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-72a659ea-24fd-4b26-889c-e089b6922728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:50.898486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 643/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:50 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:50.922126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a0982-08ff-49f1-a84c-504a8a9fc557 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:51.041016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a0982-08ff-49f1-a84c-504a8a9fc557 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:51.077030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:51.077839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:51.078124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:51.078407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:51.079067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:51.080464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:51.093151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:51.094300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:51.095511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 655/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:41:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:51.100345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a659ea-24fd-4b26-889c-e089b6922728 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:51.120068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:51.205909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a659ea-24fd-4b26-889c-e089b6922728 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:51.242779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:51.243451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:51.243740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:51.244023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:51.244771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:51.245088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:51.246475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:51.251810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 644/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 30 12:41:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:51.258060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:51.293476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:51.370067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0a7db8-3617-4a03-a9da-9cc18e9c2ef6 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:51.406018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01a71-6b17-483d-93b6-b83a1368b6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:51.406678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01a71-6b17-483d-93b6-b83a1368b6fb None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:51.406961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01a71-6b17-483d-93b6-b83a1368b6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:51.407243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01a71-6b17-483d-93b6-b83a1368b6fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:51.408022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01a71-6b17-483d-93b6-b83a1368b6fb None admin] RBAC: Adding query filter params (interface=public, service_id=3fc8ff7e859f41b7ad2c922befd1058a, region_id=RegionOne) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:51.408331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01a71-6b17-483d-93b6-b83a1368b6fb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:51.409721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01a71-6b17-483d-93b6-b83a1368b6fb None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:51.415239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 656/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Thu Jun 30 12:41:51 2022] GET /identity/v3/endpoints?service_id=3fc8ff7e859f41b7ad2c922befd1058a&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:51.420982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:51.502192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:51.522081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d5d44c-d3ab-4bae-a1f5-f6c8c379e156 None admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:51.558788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97495eb7-8b2f-4910-874f-258daa830391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:51.559373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495eb7-8b2f-4910-874f-258daa830391 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:51.559662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495eb7-8b2f-4910-874f-258daa830391 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:51.559943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97495eb7-8b2f-4910-874f-258daa830391 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:51.560661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97495eb7-8b2f-4910-874f-258daa830391 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:51.562049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97495eb7-8b2f-4910-874f-258daa830391 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:51.570312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 645/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Thu Jun 30 12:41:51 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:41:53.701591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ea61-bb5c-4f41-814c-6c21f4e312fa None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:53.702087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ea61-bb5c-4f41-814c-6c21f4e312fa None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:53.702216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9779ea61-bb5c-4f41-814c-6c21f4e312fa None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:53.703525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 657/1302] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:41:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:41:53.709242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052510bf-b39d-4ed2-bffc-f5ea2b2b74d1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:53.709705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052510bf-b39d-4ed2-bffc-f5ea2b2b74d1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:53.709952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052510bf-b39d-4ed2-bffc-f5ea2b2b74d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:53.732351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-052510bf-b39d-4ed2-bffc-f5ea2b2b74d1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:41:53.733627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-052510bf-b39d-4ed2-bffc-f5ea2b2b74d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:41:53.818685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 646/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:41:53 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 30 12:41:53.843809 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ea61-bb5c-4f41-814c-6c21f4e312fa None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:53.958247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:53.966916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9779ea61-bb5c-4f41-814c-6c21f4e312fa None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:54.003999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:54.004856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:54.005145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:54.005425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:54.006088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:54.007905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 30 12:41:54.020726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 30 12:41:54.023145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.get_or_create( Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application with Lock( Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self._enter() Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application return self.creator() Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application created_value = creator( Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: ERROR keystone.server.flask.application Jun 30 12:41:54.025021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 658/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Thu Jun 30 12:41:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 30 12:41:54.028931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052510bf-b39d-4ed2-bffc-f5ea2b2b74d1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:54.115826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:41:54.153071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052510bf-b39d-4ed2-bffc-f5ea2b2b74d1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:54.192598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba837f1-65f4-4c2d-ab7a-c0b76c600b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:54.193278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba837f1-65f4-4c2d-ab7a-c0b76c600b70 None admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:54.193642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba837f1-65f4-4c2d-ab7a-c0b76c600b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:54.193924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba837f1-65f4-4c2d-ab7a-c0b76c600b70 None admin] PATH_INFO: `/v3/services` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:54.194839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba837f1-65f4-4c2d-ab7a-c0b76c600b70 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:41:54.195400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba837f1-65f4-4c2d-ab7a-c0b76c600b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:54.196914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba837f1-65f4-4c2d-ab7a-c0b76c600b70 None admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:54.202881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 647/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Thu Jun 30 12:41:54 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:41:54.209206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:41:54.329266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a466f39-36fe-4f0e-92b4-357e1b9808c8 None admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:41:54.366934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c59d3-a64c-426e-8c5e-1e3e4e07b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:41:54.367610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c59d3-a64c-426e-8c5e-1e3e4e07b131 None admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:41:54.367898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c59d3-a64c-426e-8c5e-1e3e4e07b131 None admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:41:54.368175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c59d3-a64c-426e-8c5e-1e3e4e07b131 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:41:54.369036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c59d3-a64c-426e-8c5e-1e3e4e07b131 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:41:54.370705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c59d3-a64c-426e-8c5e-1e3e4e07b131 None admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:41:54.393361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 659/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Thu Jun 30 12:41:54 2022] POST /identity/v3/endpoints => generated 331 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:42:04.199714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=30 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:42:04.388301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:02.934299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14776-18d7-47ce-b9bb-3bba183ce3c8 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:02.934867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14776-18d7-47ce-b9bb-3bba183ce3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:02.934867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c14776-18d7-47ce-b9bb-3bba183ce3c8 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:02.936602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 648/1307] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:02.942962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cdd3c-7836-467d-90f5-25e76282bd0a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:02.943535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cdd3c-7836-467d-90f5-25e76282bd0a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:02.943535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4cdd3c-7836-467d-90f5-25e76282bd0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:03.159220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5b4cdd3c-7836-467d-90f5-25e76282bd0a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:03.160657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5b4cdd3c-7836-467d-90f5-25e76282bd0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:03.395304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 660/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:03.468676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e09b-8dcc-4d8b-8727-36dbb91da71a None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:03.469451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e09b-8dcc-4d8b-8727-36dbb91da71a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:03.469960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b8e09b-8dcc-4d8b-8727-36dbb91da71a None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:03.471974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 649/1309] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jun 30 12:43:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:03.488868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7134-fcef-4f93-b59a-08c05982c2e9 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:03.489105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7134-fcef-4f93-b59a-08c05982c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:03.489378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87c7134-fcef-4f93-b59a-08c05982c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:03.682793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-b87c7134-fcef-4f93-b59a-08c05982c2e9 None None] MFA Rules not processed for user `b35298e764904e9884012cafea48a794`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:03.684318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b87c7134-fcef-4f93-b59a-08c05982c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:03.714150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:03.786092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 661/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jun 30 12:43:03 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:03.796460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8e09b-8dcc-4d8b-8727-36dbb91da71a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:03.798588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d6b8e09b-8dcc-4d8b-8727-36dbb91da71a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:03.928691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b8e09b-8dcc-4d8b-8727-36dbb91da71a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:04.010718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045e4158-7436-40cf-88f5-1a9062084cbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:04.011374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e4158-7436-40cf-88f5-1a9062084cbc service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:04.011658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e4158-7436-40cf-88f5-1a9062084cbc service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:04.011943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045e4158-7436-40cf-88f5-1a9062084cbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:04.013626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-045e4158-7436-40cf-88f5-1a9062084cbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:04.074031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:04.141625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e4158-7436-40cf-88f5-1a9062084cbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:04.142992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045e4158-7436-40cf-88f5-1a9062084cbc service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:04.169707 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 650/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:06.670348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30a9c-092d-4cca-b34c-52af68bcafe4 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:06.670906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30a9c-092d-4cca-b34c-52af68bcafe4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:06.670906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb30a9c-092d-4cca-b34c-52af68bcafe4 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:06.672254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 662/1312] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:43:06.677780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29bc41-cc1b-4378-8295-028712551f27 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:06.678299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29bc41-cc1b-4378-8295-028712551f27 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:06.678394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff29bc41-cc1b-4378-8295-028712551f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:06.758691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ff29bc41-cc1b-4378-8295-028712551f27 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:06.759960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ff29bc41-cc1b-4378-8295-028712551f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:06.880809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 651/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:43:06.934324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291077-16fe-46d3-b771-f7c5bd314663 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:06.934602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291077-16fe-46d3-b771-f7c5bd314663 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:06.935312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2291077-16fe-46d3-b771-f7c5bd314663 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:06.936481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 663/1314] 10.222.0.20 () {54 vars in 964 bytes} [Thu Jun 30 12:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:06.946300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f67aea-dbc8-47e9-9993-d785f1c34d51 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:06.946587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f67aea-dbc8-47e9-9993-d785f1c34d51 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:06.947014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f67aea-dbc8-47e9-9993-d785f1c34d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:06.958474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:07.034045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-53f67aea-dbc8-47e9-9993-d785f1c34d51 None None] MFA Rules not processed for user `b35298e764904e9884012cafea48a794`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:07.035318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-53f67aea-dbc8-47e9-9993-d785f1c34d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:07.117957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 652/1315] 10.222.0.20 () {58 vars in 1061 bytes} [Thu Jun 30 12:43:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:07.127579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291077-16fe-46d3-b771-f7c5bd314663 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:07.130421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f2291077-16fe-46d3-b771-f7c5bd314663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:07.250212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2291077-16fe-46d3-b771-f7c5bd314663 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:07.348338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:07.351247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ce6e9c-0dab-40ed-b7c3-faeea3da6634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:07.352154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce6e9c-0dab-40ed-b7c3-faeea3da6634 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:07.352732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce6e9c-0dab-40ed-b7c3-faeea3da6634 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:07.353227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ce6e9c-0dab-40ed-b7c3-faeea3da6634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:07.355170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-36ce6e9c-0dab-40ed-b7c3-faeea3da6634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:07.476805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce6e9c-0dab-40ed-b7c3-faeea3da6634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:07.478260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ce6e9c-0dab-40ed-b7c3-faeea3da6634 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:07.499769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 664/1316] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:10.220264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a2e94-2228-4f4e-987a-1c7f621e08af None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:10.220827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a2e94-2228-4f4e-987a-1c7f621e08af None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:10.220827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a2e94-2228-4f4e-987a-1c7f621e08af None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:10.222461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 653/1317] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:10.227684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68bc6-fc3c-433c-a508-6b563d172780 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:10.228069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68bc6-fc3c-433c-a508-6b563d172780 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:10.228248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d68bc6-fc3c-433c-a508-6b563d172780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:10.293792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e1d68bc6-fc3c-433c-a508-6b563d172780 None None] MFA Rules not processed for user `b6b705ca69f04d488757f912f5f87a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:10.295007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e1d68bc6-fc3c-433c-a508-6b563d172780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:10.348442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:10.393768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 665/1318] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:10 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:10.433839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a2e94-2228-4f4e-987a-1c7f621e08af None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:10.435404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a76a2e94-2228-4f4e-987a-1c7f621e08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:10.546332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a2e94-2228-4f4e-987a-1c7f621e08af None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:10.549187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:10.623390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6d85ca-3986-4d31-9c7b-fae1c8e0dd2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:10.624063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d85ca-3986-4d31-9c7b-fae1c8e0dd2f service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:10.624356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d85ca-3986-4d31-9c7b-fae1c8e0dd2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:10.624673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6d85ca-3986-4d31-9c7b-fae1c8e0dd2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:10.626357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cf6d85ca-3986-4d31-9c7b-fae1c8e0dd2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:10.742596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d85ca-3986-4d31-9c7b-fae1c8e0dd2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:10.744064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6d85ca-3986-4d31-9c7b-fae1c8e0dd2f service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:10.764775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 654/1319] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:10 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:13.469944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e95a1b-3530-4605-9058-c4005513ded1 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:13.470541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e95a1b-3530-4605-9058-c4005513ded1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:13.470541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e95a1b-3530-4605-9058-c4005513ded1 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:13.471900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 666/1320] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:13.477561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609e945-ff91-4191-9681-337fea950994 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:13.478064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609e945-ff91-4191-9681-337fea950994 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:13.478226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e609e945-ff91-4191-9681-337fea950994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:13.520875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:13.556118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e609e945-ff91-4191-9681-337fea950994 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:13.557451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e609e945-ff91-4191-9681-337fea950994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:13.662428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 655/1321] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:13 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:13.702357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e95a1b-3530-4605-9058-c4005513ded1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:13.703938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a6e95a1b-3530-4605-9058-c4005513ded1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:13.816649 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e95a1b-3530-4605-9058-c4005513ded1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:13.901491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9b01e5-e1c9-48b0-ae1e-7fd6855468db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:13.902154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b01e5-e1c9-48b0-ae1e-7fd6855468db service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:13.902446 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b01e5-e1c9-48b0-ae1e-7fd6855468db service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:13.902731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9b01e5-e1c9-48b0-ae1e-7fd6855468db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:13.904474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bd9b01e5-e1c9-48b0-ae1e-7fd6855468db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:13.913293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:14.029770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b01e5-e1c9-48b0-ae1e-7fd6855468db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:14.031264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9b01e5-e1c9-48b0-ae1e-7fd6855468db service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:14.051087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 667/1322] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:13 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:17.027623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6b8f-9773-4cce-90b8-cdf69bedfcae None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:17.028245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6b8f-9773-4cce-90b8-cdf69bedfcae None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:17.028245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b6b8f-9773-4cce-90b8-cdf69bedfcae None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:17.029610 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 656/1323] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:17.035471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739dfcc-2e9e-4cb7-adf2-1261e386266b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:17.036045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739dfcc-2e9e-4cb7-adf2-1261e386266b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:17.036147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1739dfcc-2e9e-4cb7-adf2-1261e386266b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:17.118081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1739dfcc-2e9e-4cb7-adf2-1261e386266b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:17.119366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1739dfcc-2e9e-4cb7-adf2-1261e386266b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:17.192870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:17.241274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 668/1324] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:17.281257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b6b8f-9773-4cce-90b8-cdf69bedfcae None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:17.282874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a39b6b8f-9773-4cce-90b8-cdf69bedfcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:17.430946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b6b8f-9773-4cce-90b8-cdf69bedfcae None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:17.445009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:17.521039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fc1bc3-83af-4fbf-918c-d0f8ca176130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:17.521715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1bc3-83af-4fbf-918c-d0f8ca176130 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:17.521995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1bc3-83af-4fbf-918c-d0f8ca176130 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:17.522282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fc1bc3-83af-4fbf-918c-d0f8ca176130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:17.524034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f1fc1bc3-83af-4fbf-918c-d0f8ca176130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:17.705317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc1bc3-83af-4fbf-918c-d0f8ca176130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:17.707405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fc1bc3-83af-4fbf-918c-d0f8ca176130 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:17.730333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 657/1325] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:43:20.038662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad03ce-1d1e-4b08-827a-8549825b24af None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:20.039270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad03ce-1d1e-4b08-827a-8549825b24af None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:20.039270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad03ce-1d1e-4b08-827a-8549825b24af None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:20.040837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 669/1326] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:20.047103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9515-9685-41b5-98f8-a99bf0677b02 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:20.047669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9515-9685-41b5-98f8-a99bf0677b02 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:20.047871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b9515-9685-41b5-98f8-a99bf0677b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:20.103552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:20.127197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6f2b9515-9685-41b5-98f8-a99bf0677b02 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:20.129141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6f2b9515-9685-41b5-98f8-a99bf0677b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:20.274482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 658/1327] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:20.315220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad03ce-1d1e-4b08-827a-8549825b24af None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:20.317558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-54ad03ce-1d1e-4b08-827a-8549825b24af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:20.453637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad03ce-1d1e-4b08-827a-8549825b24af None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:20.546082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dacaeb-17d2-4f3e-bc29-ef48f68ae4ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:20.546695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dacaeb-17d2-4f3e-bc29-ef48f68ae4ba service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:20.547040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dacaeb-17d2-4f3e-bc29-ef48f68ae4ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:20.547328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dacaeb-17d2-4f3e-bc29-ef48f68ae4ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:20.549102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-37dacaeb-17d2-4f3e-bc29-ef48f68ae4ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:20.568802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:20.701333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dacaeb-17d2-4f3e-bc29-ef48f68ae4ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:20.702842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dacaeb-17d2-4f3e-bc29-ef48f68ae4ba service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:20.724329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 670/1328] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:22.899006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9d75-2515-4622-b94d-887bd4683f92 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:22.899565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9d75-2515-4622-b94d-887bd4683f92 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:22.899565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd9d75-2515-4622-b94d-887bd4683f92 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:22.900944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 659/1329] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:22.906493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9522-4712-4fe9-ab26-b36c24136c56 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:22.907014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9522-4712-4fe9-ab26-b36c24136c56 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:22.907116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b9522-4712-4fe9-ab26-b36c24136c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:22.980641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-2b7b9522-4712-4fe9-ab26-b36c24136c56 None None] MFA Rules not processed for user `b6b705ca69f04d488757f912f5f87a37`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:22.981822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2b7b9522-4712-4fe9-ab26-b36c24136c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:23.061589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:23.100768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 671/1330] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:22 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:23.139412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd9d75-2515-4622-b94d-887bd4683f92 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:23.141273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b2cd9d75-2515-4622-b94d-887bd4683f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:23.286945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd9d75-2515-4622-b94d-887bd4683f92 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:23.323478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:23.404497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dce366-b2db-4bc6-b247-812ed02b617d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:23.405162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce366-b2db-4bc6-b247-812ed02b617d service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:23.405449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce366-b2db-4bc6-b247-812ed02b617d service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:23.405728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dce366-b2db-4bc6-b247-812ed02b617d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:23.407431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f9dce366-b2db-4bc6-b247-812ed02b617d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:23.549009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dce366-b2db-4bc6-b247-812ed02b617d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:23.550615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dce366-b2db-4bc6-b247-812ed02b617d service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:23.571195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 660/1331] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:23 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:26.257892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312f11-083b-408b-a370-fb16db87be8a None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:26.258508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312f11-083b-408b-a370-fb16db87be8a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:26.258508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07312f11-083b-408b-a370-fb16db87be8a None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:26.259810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 672/1332] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:26.265575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627e20-51b2-4fd0-8dee-8b2dbf621578 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:26.266023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627e20-51b2-4fd0-8dee-8b2dbf621578 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:26.266228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb627e20-51b2-4fd0-8dee-8b2dbf621578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:26.332583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:26.335439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-bb627e20-51b2-4fd0-8dee-8b2dbf621578 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:26.337240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bb627e20-51b2-4fd0-8dee-8b2dbf621578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:26.440214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 661/1333] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:26.478026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312f11-083b-408b-a370-fb16db87be8a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:26.479567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-07312f11-083b-408b-a370-fb16db87be8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:26.593320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07312f11-083b-408b-a370-fb16db87be8a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:26.671133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdee271-5503-4c7d-a171-ddf82b4b7e35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:26.671790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdee271-5503-4c7d-a171-ddf82b4b7e35 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:26.672078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdee271-5503-4c7d-a171-ddf82b4b7e35 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:26.672358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdee271-5503-4c7d-a171-ddf82b4b7e35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:26.674037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4fdee271-5503-4c7d-a171-ddf82b4b7e35 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:26.701972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:26.787635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdee271-5503-4c7d-a171-ddf82b4b7e35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:26.789130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdee271-5503-4c7d-a171-ddf82b4b7e35 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:26.808942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 673/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:28.967795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304f93-d017-4110-800b-6a8228ef7b04 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:28.968356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304f93-d017-4110-800b-6a8228ef7b04 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:28.968356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2304f93-d017-4110-800b-6a8228ef7b04 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:28.969701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 662/1335] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:28.975651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690949-f0d7-4c35-9806-cb2f7a41a074 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:28.976118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690949-f0d7-4c35-9806-cb2f7a41a074 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:28.976214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9690949-f0d7-4c35-9806-cb2f7a41a074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:29.045337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e9690949-f0d7-4c35-9806-cb2f7a41a074 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:29.046565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e9690949-f0d7-4c35-9806-cb2f7a41a074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:29.123001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:29.148332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 674/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:29.192326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2304f93-d017-4110-800b-6a8228ef7b04 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:29.193927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f2304f93-d017-4110-800b-6a8228ef7b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:29.302651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2304f93-d017-4110-800b-6a8228ef7b04 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:29.333453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:29.382544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d4126-2964-4f3f-b91f-3efb65655c6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:29.382781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4126-2964-4f3f-b91f-3efb65655c6d service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:29.383053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4126-2964-4f3f-b91f-3efb65655c6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:29.383334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d4126-2964-4f3f-b91f-3efb65655c6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:29.385089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-858d4126-2964-4f3f-b91f-3efb65655c6d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:29.519856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4126-2964-4f3f-b91f-3efb65655c6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:29.521350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d4126-2964-4f3f-b91f-3efb65655c6d service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:29.546805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 663/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:32.109602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bbb0d-35eb-451a-ab4f-41ea21910acf None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:32.110144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bbb0d-35eb-451a-ab4f-41ea21910acf None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:32.110144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bbb0d-35eb-451a-ab4f-41ea21910acf None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:32.111512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 675/1338] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:32.118398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415253a7-aea5-415d-942d-c10d24c93f20 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:32.118925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415253a7-aea5-415d-942d-c10d24c93f20 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:32.119030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415253a7-aea5-415d-942d-c10d24c93f20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:32.187588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-415253a7-aea5-415d-942d-c10d24c93f20 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:32.188862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-415253a7-aea5-415d-942d-c10d24c93f20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:32.199210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:32.302119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 664/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:32 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:32.341274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bbb0d-35eb-451a-ab4f-41ea21910acf None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:32.342843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-394bbb0d-35eb-451a-ab4f-41ea21910acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:32.458589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bbb0d-35eb-451a-ab4f-41ea21910acf None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:32.539964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2ff130-438a-4031-8bfe-a33fe191b824 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:32.540653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff130-438a-4031-8bfe-a33fe191b824 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:32.540939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff130-438a-4031-8bfe-a33fe191b824 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:32.541219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2ff130-438a-4031-8bfe-a33fe191b824 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:32.542875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6b2ff130-438a-4031-8bfe-a33fe191b824 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:32.579352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:32.655551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ff130-438a-4031-8bfe-a33fe191b824 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:32.657048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2ff130-438a-4031-8bfe-a33fe191b824 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:32.676649 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 676/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:32 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:36.901491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ef9f-972d-4183-af3b-10e7ac8ad180 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:36.902063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ef9f-972d-4183-af3b-10e7ac8ad180 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:36.902063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9821ef9f-972d-4183-af3b-10e7ac8ad180 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:36.903437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 665/1341] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:36.908975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324d0c-9637-4298-a101-9518d3a75c03 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:36.909416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324d0c-9637-4298-a101-9518d3a75c03 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:36.909529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd324d0c-9637-4298-a101-9518d3a75c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:36.982407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bd324d0c-9637-4298-a101-9518d3a75c03 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:36.983644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bd324d0c-9637-4298-a101-9518d3a75c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:37.093079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:37.106829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 677/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:37.149434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821ef9f-972d-4183-af3b-10e7ac8ad180 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:37.151933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9821ef9f-972d-4183-af3b-10e7ac8ad180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:37.254987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9821ef9f-972d-4183-af3b-10e7ac8ad180 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:37.258781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057689a-f2a1-4ac8-a5ee-71d58e750f70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:37.259442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057689a-f2a1-4ac8-a5ee-71d58e750f70 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:37.259728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057689a-f2a1-4ac8-a5ee-71d58e750f70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:37.260013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057689a-f2a1-4ac8-a5ee-71d58e750f70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:37.271865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057689a-f2a1-4ac8-a5ee-71d58e750f70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:37.273457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057689a-f2a1-4ac8-a5ee-71d58e750f70 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:37.287705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 666/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:40.136787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d639-5028-4990-a6ea-e0994d305e23 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:40.137335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d639-5028-4990-a6ea-e0994d305e23 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:40.137335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5059d639-5028-4990-a6ea-e0994d305e23 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:40.138767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 678/1344] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:40.145076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a54d8-bd77-4c8d-bbcb-bb1060c53384 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:40.145658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a54d8-bd77-4c8d-bbcb-bb1060c53384 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:40.145658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072a54d8-bd77-4c8d-bbcb-bb1060c53384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:40.176678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-072a54d8-bd77-4c8d-bbcb-bb1060c53384 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:40.177920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-072a54d8-bd77-4c8d-bbcb-bb1060c53384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:40.209840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:40.263889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 667/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:40 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:40.307939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d639-5028-4990-a6ea-e0994d305e23 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:40.319147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5059d639-5028-4990-a6ea-e0994d305e23 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:40.322786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e3fc9d-f44f-4e30-865b-02fa0aa6df02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:40.323517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3fc9d-f44f-4e30-865b-02fa0aa6df02 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:40.323866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3fc9d-f44f-4e30-865b-02fa0aa6df02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:40.324209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e3fc9d-f44f-4e30-865b-02fa0aa6df02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:40.333782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3fc9d-f44f-4e30-865b-02fa0aa6df02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:40.335212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e3fc9d-f44f-4e30-865b-02fa0aa6df02 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:40.344870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 679/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:40 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:44.497588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363128-6bb2-4f41-9795-74aa057992ac None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:44.498183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363128-6bb2-4f41-9795-74aa057992ac None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:44.498295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9363128-6bb2-4f41-9795-74aa057992ac None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:44.499836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 668/1347] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:44.506730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84375e55-ef0d-4b8b-9488-b843b8633339 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:44.507313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84375e55-ef0d-4b8b-9488-b843b8633339 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:44.507648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84375e55-ef0d-4b8b-9488-b843b8633339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:44.529194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-84375e55-ef0d-4b8b-9488-b843b8633339 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:44.530513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-84375e55-ef0d-4b8b-9488-b843b8633339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:44.539326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 680/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:44.579567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9363128-6bb2-4f41-9795-74aa057992ac None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:43:44.590652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9363128-6bb2-4f41-9795-74aa057992ac None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:43:44.594237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d772534-1065-4a06-8422-3a5eaf2c98bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:43:44.594884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772534-1065-4a06-8422-3a5eaf2c98bf service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:44.595175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772534-1065-4a06-8422-3a5eaf2c98bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:44.595651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d772534-1065-4a06-8422-3a5eaf2c98bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:44.605840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d772534-1065-4a06-8422-3a5eaf2c98bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:43:44.607522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d772534-1065-4a06-8422-3a5eaf2c98bf service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:43:44.618244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 669/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:43:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:43:49.818048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab955ee-ab58-4b4a-8d7a-2d7bfc50b744 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:49.818595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab955ee-ab58-4b4a-8d7a-2d7bfc50b744 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:49.818595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab955ee-ab58-4b4a-8d7a-2d7bfc50b744 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:49.819995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 681/1350] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:49.825256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd38a2e-9836-4211-9d91-4ed9299950f2 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:49.825686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd38a2e-9836-4211-9d91-4ed9299950f2 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:49.825822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd38a2e-9836-4211-9d91-4ed9299950f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:49.954164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7dd38a2e-9836-4211-9d91-4ed9299950f2 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:49.955438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7dd38a2e-9836-4211-9d91-4ed9299950f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:50.042806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 670/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:43:49 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:54.225424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18f5f-b6e0-4ce2-940f-90177674616f None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:54.226428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18f5f-b6e0-4ce2-940f-90177674616f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:54.226914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf18f5f-b6e0-4ce2-940f-90177674616f None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:54.228336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 682/1352] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:43:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:54.233528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6c7e-29ba-4274-81a1-b642af3a1e4c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:54.233938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6c7e-29ba-4274-81a1-b642af3a1e4c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:54.234086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71a6c7e-29ba-4274-81a1-b642af3a1e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:54.252706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c71a6c7e-29ba-4274-81a1-b642af3a1e4c None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:54.253892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c71a6c7e-29ba-4274-81a1-b642af3a1e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:54.263304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 671/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:43:54 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:54.523922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=13 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:43:55.961353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74384-0912-4666-a70b-c227bd3d89ed None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:55.962027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74384-0912-4666-a70b-c227bd3d89ed None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:55.962027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f74384-0912-4666-a70b-c227bd3d89ed None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:55.963429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 683/1354] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:55.969140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fbfea-adb3-440c-b3be-bd9503da25c0 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:55.969612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fbfea-adb3-440c-b3be-bd9503da25c0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:55.969823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28fbfea-adb3-440c-b3be-bd9503da25c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:55.989310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c28fbfea-adb3-440c-b3be-bd9503da25c0 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:55.990544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c28fbfea-adb3-440c-b3be-bd9503da25c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:55.999549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 672/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:43:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:59.794215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93ffd-b132-4059-ab87-ae3be50241ea None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:59.794721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93ffd-b132-4059-ab87-ae3be50241ea None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:59.794818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e93ffd-b132-4059-ab87-ae3be50241ea None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:59.796114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 684/1356] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:43:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:59.815983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167942-d623-4c23-8f6c-d55a5e79e531 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:59.816594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167942-d623-4c23-8f6c-d55a5e79e531 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:59.818471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5167942-d623-4c23-8f6c-d55a5e79e531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:59.838341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a5167942-d623-4c23-8f6c-d55a5e79e531 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:43:59.839524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a5167942-d623-4c23-8f6c-d55a5e79e531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:43:59.847957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 673/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:43:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:43:59.911205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50b2e7-d66a-48b9-abee-e66c64786462 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:59.911731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50b2e7-d66a-48b9-abee-e66c64786462 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:59.912192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c50b2e7-d66a-48b9-abee-e66c64786462 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:43:59.915792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 685/1358] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 30 12:43:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:43:59.929319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755215-ec84-4e9d-85b1-287cc52bde24 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:43:59.929319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755215-ec84-4e9d-85b1-287cc52bde24 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:43:59.929749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76755215-ec84-4e9d-85b1-287cc52bde24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:00.028894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:00.052780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-76755215-ec84-4e9d-85b1-287cc52bde24 None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:00.055363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-76755215-ec84-4e9d-85b1-287cc52bde24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:00.182028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 674/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 30 12:43:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:00.190954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50b2e7-d66a-48b9-abee-e66c64786462 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:00.206534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c50b2e7-d66a-48b9-abee-e66c64786462 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:00.213056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620a0b49-25c6-4dac-a52f-781cecd9e58a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:00.213845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a0b49-25c6-4dac-a52f-781cecd9e58a service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:00.214218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a0b49-25c6-4dac-a52f-781cecd9e58a service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:00.214598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a0b49-25c6-4dac-a52f-781cecd9e58a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:00.224520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a0b49-25c6-4dac-a52f-781cecd9e58a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:00.235641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620a0b49-25c6-4dac-a52f-781cecd9e58a service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:00.266178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 686/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:02.698295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f15d-60d6-4cf7-87c0-64b94b54a992 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:02.698772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f15d-60d6-4cf7-87c0-64b94b54a992 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:02.698867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c55f15d-60d6-4cf7-87c0-64b94b54a992 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:02.700261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 675/1361] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:02.706621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6554f-3926-477b-8d21-a5abcd8f6eed None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:02.707703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6554f-3926-477b-8d21-a5abcd8f6eed None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:02.708161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a6554f-3926-477b-8d21-a5abcd8f6eed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:02.730775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-76a6554f-3926-477b-8d21-a5abcd8f6eed None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:02.732076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-76a6554f-3926-477b-8d21-a5abcd8f6eed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:02.740907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 687/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:02.796470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f15d-60d6-4cf7-87c0-64b94b54a992 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:02.814873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c55f15d-60d6-4cf7-87c0-64b94b54a992 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:02.821742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cca8bb-1951-4cff-a2ee-d051b5a5a1b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:02.822521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca8bb-1951-4cff-a2ee-d051b5a5a1b4 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:02.822877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca8bb-1951-4cff-a2ee-d051b5a5a1b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:02.823398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cca8bb-1951-4cff-a2ee-d051b5a5a1b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:02.835315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cca8bb-1951-4cff-a2ee-d051b5a5a1b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:02.837124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cca8bb-1951-4cff-a2ee-d051b5a5a1b4 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:02.851842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 676/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:44:05.402802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07e08b-20b3-4a4a-afcc-46b4471a276e None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:05.403819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07e08b-20b3-4a4a-afcc-46b4471a276e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:05.404132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c07e08b-20b3-4a4a-afcc-46b4471a276e None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:05.406077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 688/1364] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:05.422477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545e5a5-ce8a-45eb-9252-8b3bb4d6d1d1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:05.423019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545e5a5-ce8a-45eb-9252-8b3bb4d6d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:05.423019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545e5a5-ce8a-45eb-9252-8b3bb4d6d1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:05.442758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5545e5a5-ce8a-45eb-9252-8b3bb4d6d1d1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:05.443983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5545e5a5-ce8a-45eb-9252-8b3bb4d6d1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:05.452437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 677/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:05.509109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4206-b6ac-40bd-b16e-cfab939b9cda None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:05.509669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4206-b6ac-40bd-b16e-cfab939b9cda None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:05.510185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f4206-b6ac-40bd-b16e-cfab939b9cda None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:05.513629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 689/1366] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 30 12:44:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:05.526946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb8e71-2c57-4796-b6c3-0b736a3856ca None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:05.527450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb8e71-2c57-4796-b6c3-0b736a3856ca None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:05.527958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bb8e71-2c57-4796-b6c3-0b736a3856ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:05.558021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a3bb8e71-2c57-4796-b6c3-0b736a3856ca None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:05.559548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a3bb8e71-2c57-4796-b6c3-0b736a3856ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:05.572678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 678/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 30 12:44:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:05.583422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f4206-b6ac-40bd-b16e-cfab939b9cda None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:05.600460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f4206-b6ac-40bd-b16e-cfab939b9cda None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:05.606097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52354531-a8c7-4c9d-8a0a-f894502219c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:05.607072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354531-a8c7-4c9d-8a0a-f894502219c3 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:05.607353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354531-a8c7-4c9d-8a0a-f894502219c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:05.607996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52354531-a8c7-4c9d-8a0a-f894502219c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:05.617951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52354531-a8c7-4c9d-8a0a-f894502219c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:05.619557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52354531-a8c7-4c9d-8a0a-f894502219c3 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:05.632211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 690/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:07.927756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ba22-6c01-407a-a7ec-0c3248881444 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:07.928341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ba22-6c01-407a-a7ec-0c3248881444 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:07.928341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560ba22-6c01-407a-a7ec-0c3248881444 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:07.929801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 679/1369] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:44:07.935879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22d7f-9a9b-4580-89bb-2ed80a83dfe2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:07.936754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22d7f-9a9b-4580-89bb-2ed80a83dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:07.936754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f22d7f-9a9b-4580-89bb-2ed80a83dfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:07.967633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-b8f22d7f-9a9b-4580-89bb-2ed80a83dfe2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:07.969355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b8f22d7f-9a9b-4580-89bb-2ed80a83dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:07.980456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 691/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:08.046166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ba22-6c01-407a-a7ec-0c3248881444 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:08.062365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560ba22-6c01-407a-a7ec-0c3248881444 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:08.068817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380134a-55ae-4268-8afb-6652e1e23b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:08.069649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380134a-55ae-4268-8afb-6652e1e23b5e service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:08.070043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380134a-55ae-4268-8afb-6652e1e23b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:08.070431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380134a-55ae-4268-8afb-6652e1e23b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:08.079942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380134a-55ae-4268-8afb-6652e1e23b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:08.082574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d380134a-55ae-4268-8afb-6652e1e23b5e service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:08.094033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 680/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:08.739516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159a209-d740-4051-8d17-ad11786f5dd5 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:08.740064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159a209-d740-4051-8d17-ad11786f5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:08.740539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5159a209-d740-4051-8d17-ad11786f5dd5 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:08.742117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 692/1372] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:44:08.748149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c664ed-72d5-4c0a-a8d9-01681e1c5c13 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:08.748494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c664ed-72d5-4c0a-a8d9-01681e1c5c13 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:08.748770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c664ed-72d5-4c0a-a8d9-01681e1c5c13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:08.770296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-39c664ed-72d5-4c0a-a8d9-01681e1c5c13 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:08.772403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-39c664ed-72d5-4c0a-a8d9-01681e1c5c13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:08.782344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 681/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:09.159764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94fc6-df94-4a78-9459-49a6b3bb7aba None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:09.159764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94fc6-df94-4a78-9459-49a6b3bb7aba None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:09.159764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d94fc6-df94-4a78-9459-49a6b3bb7aba None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:09.162405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 693/1374] 10.222.0.20 () {54 vars in 963 bytes} [Thu Jun 30 12:44:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:09.171994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd199e-0c11-4dfc-98a2-3724d50636ce None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:09.171994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd199e-0c11-4dfc-98a2-3724d50636ce None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:09.171994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dd199e-0c11-4dfc-98a2-3724d50636ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:09.258258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-63dd199e-0c11-4dfc-98a2-3724d50636ce None None] MFA Rules not processed for user `6290142aced542e19cc4b23ab34a3d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:09.260091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-63dd199e-0c11-4dfc-98a2-3724d50636ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:09.364260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 682/1375] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Jun 30 12:44:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:09.365447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94fc6-df94-4a78-9459-49a6b3bb7aba None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:09.380417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d94fc6-df94-4a78-9459-49a6b3bb7aba None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:09.384956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d636839-b54e-4b4e-a8f7-205970869a27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:09.385700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636839-b54e-4b4e-a8f7-205970869a27 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:09.386030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636839-b54e-4b4e-a8f7-205970869a27 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:09.386406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d636839-b54e-4b4e-a8f7-205970869a27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:09.399955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d636839-b54e-4b4e-a8f7-205970869a27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:09.401534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d636839-b54e-4b4e-a8f7-205970869a27 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:09.417520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 694/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:10.793396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507a718-2006-4249-903e-8a2bb91d9386 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:10.793926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507a718-2006-4249-903e-8a2bb91d9386 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:10.794020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8507a718-2006-4249-903e-8a2bb91d9386 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:10.795367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 683/1377] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:10.800709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb20049-00bb-4fdb-91d2-4b8358b1a56f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:10.801168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb20049-00bb-4fdb-91d2-4b8358b1a56f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:10.801311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb20049-00bb-4fdb-91d2-4b8358b1a56f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:10.821338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9cb20049-00bb-4fdb-91d2-4b8358b1a56f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:10.822568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9cb20049-00bb-4fdb-91d2-4b8358b1a56f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:10.831165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 695/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:10.876632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507a718-2006-4249-903e-8a2bb91d9386 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:10.896034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8507a718-2006-4249-903e-8a2bb91d9386 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:10.901743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b19aee-a7ed-48ec-ade3-2ee1c48a17ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:10.902399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b19aee-a7ed-48ec-ade3-2ee1c48a17ab service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:10.902704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b19aee-a7ed-48ec-ade3-2ee1c48a17ab service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:10.902972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b19aee-a7ed-48ec-ade3-2ee1c48a17ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:10.911902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b19aee-a7ed-48ec-ade3-2ee1c48a17ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:10.913538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b19aee-a7ed-48ec-ade3-2ee1c48a17ab service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:10.917672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:10.929602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 684/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:13.218027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f828-94a7-4d34-8679-2239d31bb6ba None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:13.218932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f828-94a7-4d34-8679-2239d31bb6ba None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:13.218932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76f828-94a7-4d34-8679-2239d31bb6ba None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:13.221330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 696/1380] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:13.228618 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ec7d-7f3d-4e76-b8da-18098267f322 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:13.229168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ec7d-7f3d-4e76-b8da-18098267f322 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:13.229606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680ec7d-7f3d-4e76-b8da-18098267f322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:13.254217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2680ec7d-7f3d-4e76-b8da-18098267f322 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:13.255470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2680ec7d-7f3d-4e76-b8da-18098267f322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:13.263938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 685/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:13.315036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76f828-94a7-4d34-8679-2239d31bb6ba None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:13.335797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76f828-94a7-4d34-8679-2239d31bb6ba None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:13.341877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7524872-86a2-4529-83c7-c0f0f369eeb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:13.342578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524872-86a2-4529-83c7-c0f0f369eeb0 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:13.342839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524872-86a2-4529-83c7-c0f0f369eeb0 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:13.343123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7524872-86a2-4529-83c7-c0f0f369eeb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:13.353706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7524872-86a2-4529-83c7-c0f0f369eeb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:13.355269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7524872-86a2-4529-83c7-c0f0f369eeb0 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:13.369303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 697/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:15.689587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41b47-b634-4d4c-b227-17ff3c7ddc4c None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:15.690546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41b47-b634-4d4c-b227-17ff3c7ddc4c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:15.690987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c41b47-b634-4d4c-b227-17ff3c7ddc4c None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:15.696826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 686/1383] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:15.698297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f588-9a7f-4da8-b484-7b1ed13ca066 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:15.699009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f588-9a7f-4da8-b484-7b1ed13ca066 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:15.699009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d364f588-9a7f-4da8-b484-7b1ed13ca066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:15.726409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-d364f588-9a7f-4da8-b484-7b1ed13ca066 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:15.728772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d364f588-9a7f-4da8-b484-7b1ed13ca066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:15.752485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 698/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:44:15.817831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c41b47-b634-4d4c-b227-17ff3c7ddc4c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:15.846622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c41b47-b634-4d4c-b227-17ff3c7ddc4c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:15.855839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0976e8d-6da3-402b-b2c7-dcd3112a7b5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:15.857248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976e8d-6da3-402b-b2c7-dcd3112a7b5e service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:15.857897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976e8d-6da3-402b-b2c7-dcd3112a7b5e service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:15.858406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0976e8d-6da3-402b-b2c7-dcd3112a7b5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:15.874657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0976e8d-6da3-402b-b2c7-dcd3112a7b5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:15.877204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0976e8d-6da3-402b-b2c7-dcd3112a7b5e service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:15.898699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 687/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:18.427393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee7ea-e674-4681-9fdc-61fbbf928428 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:18.427947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee7ea-e674-4681-9fdc-61fbbf928428 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:18.427947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee7ea-e674-4681-9fdc-61fbbf928428 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:18.429428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 699/1386] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:18.435550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369656-670f-4167-a365-2b295fd10977 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:18.436325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369656-670f-4167-a365-2b295fd10977 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:18.436325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e369656-670f-4167-a365-2b295fd10977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:18.469158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1e369656-670f-4167-a365-2b295fd10977 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:18.470310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1e369656-670f-4167-a365-2b295fd10977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:18.483621 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 688/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:18.535322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caee7ea-e674-4681-9fdc-61fbbf928428 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:18.555104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caee7ea-e674-4681-9fdc-61fbbf928428 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:18.561819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95173f80-d9d8-4b58-8c7d-ac80aa207149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:18.562763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173f80-d9d8-4b58-8c7d-ac80aa207149 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:18.563242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173f80-d9d8-4b58-8c7d-ac80aa207149 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:18.563697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95173f80-d9d8-4b58-8c7d-ac80aa207149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:18.578647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95173f80-d9d8-4b58-8c7d-ac80aa207149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:18.581823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95173f80-d9d8-4b58-8c7d-ac80aa207149 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:18.599198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 700/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:21.161885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4d0d0-6ae0-4712-a8a6-ec0f51f395e4 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:21.162478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4d0d0-6ae0-4712-a8a6-ec0f51f395e4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:21.162894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce4d0d0-6ae0-4712-a8a6-ec0f51f395e4 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:21.165743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 689/1389] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:21.172492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27d90b-c1e9-4479-afee-6717f7aaef1f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:21.175238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27d90b-c1e9-4479-afee-6717f7aaef1f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:21.175238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c27d90b-c1e9-4479-afee-6717f7aaef1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:21.195033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-0c27d90b-c1e9-4479-afee-6717f7aaef1f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:21.196341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-0c27d90b-c1e9-4479-afee-6717f7aaef1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:21.205785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 701/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:44:21.272241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4d0d0-6ae0-4712-a8a6-ec0f51f395e4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:21.292563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce4d0d0-6ae0-4712-a8a6-ec0f51f395e4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:21.302779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12e7029-206e-4e8d-8177-10d353dda06d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:21.303875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7029-206e-4e8d-8177-10d353dda06d service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:21.304416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7029-206e-4e8d-8177-10d353dda06d service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:21.305036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12e7029-206e-4e8d-8177-10d353dda06d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:21.321829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e7029-206e-4e8d-8177-10d353dda06d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:21.324797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12e7029-206e-4e8d-8177-10d353dda06d service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:21.344609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 690/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:23.580622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1a12-58ab-47a1-b710-379fba4c3569 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:23.581791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1a12-58ab-47a1-b710-379fba4c3569 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:23.581791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610e1a12-58ab-47a1-b710-379fba4c3569 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:23.582631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 702/1392] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:23.588496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de135-1cb2-4fc1-a7c7-41bf6c6311e8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:23.589104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de135-1cb2-4fc1-a7c7-41bf6c6311e8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:23.589104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3de135-1cb2-4fc1-a7c7-41bf6c6311e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:23.608350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1a3de135-1cb2-4fc1-a7c7-41bf6c6311e8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:23.609558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1a3de135-1cb2-4fc1-a7c7-41bf6c6311e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:23.619098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 691/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:44:23.668438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e1a12-58ab-47a1-b710-379fba4c3569 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:23.686255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610e1a12-58ab-47a1-b710-379fba4c3569 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:23.693698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1a14f-d6be-458f-aa27-586e6d83725a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:23.694373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1a14f-d6be-458f-aa27-586e6d83725a service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:23.694663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1a14f-d6be-458f-aa27-586e6d83725a service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:23.694944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1a14f-d6be-458f-aa27-586e6d83725a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:23.704310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1a14f-d6be-458f-aa27-586e6d83725a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:23.707320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be1a14f-d6be-458f-aa27-586e6d83725a service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:23.717992 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 703/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:44:26.097650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c57e3-7458-4605-a741-309ea7eafa80 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.098224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c57e3-7458-4605-a741-309ea7eafa80 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.098224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c57e3-7458-4605-a741-309ea7eafa80 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.099649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 692/1395] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:26.105538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9839-9351-4477-b492-139c7e13f5ab None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.106484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9839-9351-4477-b492-139c7e13f5ab None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.106484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab9839-9351-4477-b492-139c7e13f5ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.116035 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=52 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:26.129682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e8ab9839-9351-4477-b492-139c7e13f5ab None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:26.130910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e8ab9839-9351-4477-b492-139c7e13f5ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:26.139325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 704/1396] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:26.193757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c57e3-7458-4605-a741-309ea7eafa80 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:26.209577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c57e3-7458-4605-a741-309ea7eafa80 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:26.215269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19bb09-1474-4588-adcc-a4d211a35eaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:26.215935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19bb09-1474-4588-adcc-a4d211a35eaf service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.216231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19bb09-1474-4588-adcc-a4d211a35eaf service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.216549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19bb09-1474-4588-adcc-a4d211a35eaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.226654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19bb09-1474-4588-adcc-a4d211a35eaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:26.228314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19bb09-1474-4588-adcc-a4d211a35eaf service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:26.239885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 693/1397] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:26.301474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efec6-4e4c-4917-8535-f4d1ef14636a None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.301751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efec6-4e4c-4917-8535-f4d1ef14636a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.302070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731efec6-4e4c-4917-8535-f4d1ef14636a None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.303626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 705/1398] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:26.309738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f703-2e06-4476-908e-52b8a35456fb None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.310032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f703-2e06-4476-908e-52b8a35456fb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.310335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06f703-2e06-4476-908e-52b8a35456fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.335221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-fd06f703-2e06-4476-908e-52b8a35456fb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:26.336783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fd06f703-2e06-4476-908e-52b8a35456fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:26.346868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 694/1399] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:26.432202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bab8dd-1178-4557-a2fe-8835d3e28567 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.432726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bab8dd-1178-4557-a2fe-8835d3e28567 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.432886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bab8dd-1178-4557-a2fe-8835d3e28567 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.434244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 706/1400] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jun 30 12:44:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:26.441347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a69c56-6190-4a9e-838a-e43c37247e90 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.441863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a69c56-6190-4a9e-838a-e43c37247e90 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.442210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a69c56-6190-4a9e-838a-e43c37247e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.509340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c5a69c56-6190-4a9e-838a-e43c37247e90 None None] MFA Rules not processed for user `18e34e8f236f4f09a456e10221e2e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:26.510593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c5a69c56-6190-4a9e-838a-e43c37247e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:26.586947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 695/1401] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jun 30 12:44:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:26.596267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bab8dd-1178-4557-a2fe-8835d3e28567 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:26.612888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bab8dd-1178-4557-a2fe-8835d3e28567 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:26.616507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc31182-f85f-4839-bf19-9bd1c1e11e86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e34e8f236f4f09a456e10221e2e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:26.617178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31182-f85f-4839-bf19-9bd1c1e11e86 service glance] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:26.617783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31182-f85f-4839-bf19-9bd1c1e11e86 service glance] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:26.618303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc31182-f85f-4839-bf19-9bd1c1e11e86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:26.629792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc31182-f85f-4839-bf19-9bd1c1e11e86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:26.631565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc31182-f85f-4839-bf19-9bd1c1e11e86 service glance] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:26.646661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 707/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:27.417190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e395f9-d64f-456e-81af-5c988c24c140 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:27.417684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e395f9-d64f-456e-81af-5c988c24c140 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:27.417893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e395f9-d64f-456e-81af-5c988c24c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:27.470810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-49e395f9-d64f-456e-81af-5c988c24c140 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:27.472055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-49e395f9-d64f-456e-81af-5c988c24c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:27.515286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:27.541039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 696/1403] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:44:27 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:27.598891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec46f-9280-4ae4-922f-16e8acb9fe2b None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:27.599405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec46f-9280-4ae4-922f-16e8acb9fe2b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:27.599520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0ec46f-9280-4ae4-922f-16e8acb9fe2b None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:27.600889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 708/1404] 10.222.0.20 () {54 vars in 942 bytes} [Thu Jun 30 12:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:27.608224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3370a8-1cb3-4412-b7dc-5213b080ad5c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:27.608588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3370a8-1cb3-4412-b7dc-5213b080ad5c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:27.608882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3370a8-1cb3-4412-b7dc-5213b080ad5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:27.670245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0f3370a8-1cb3-4412-b7dc-5213b080ad5c None None] MFA Rules not processed for user `addf74dd6b6f4f78bace4808bf676acc`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:27.671858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0f3370a8-1cb3-4412-b7dc-5213b080ad5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:27.751434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 697/1405] 10.222.0.20 () {58 vars in 1039 bytes} [Thu Jun 30 12:44:27 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:27.762005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ec46f-9280-4ae4-922f-16e8acb9fe2b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:27.778272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0ec46f-9280-4ae4-922f-16e8acb9fe2b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:27.783389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ffd486-3262-40f9-9658-d06c83b4f0e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:27.784050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd486-3262-40f9-9658-d06c83b4f0e0 service swift] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:27.784338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd486-3262-40f9-9658-d06c83b4f0e0 service swift] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:27.784652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ffd486-3262-40f9-9658-d06c83b4f0e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:27.793830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffd486-3262-40f9-9658-d06c83b4f0e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:27.795425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ffd486-3262-40f9-9658-d06c83b4f0e0 service swift] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:27.805013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 709/1406] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:44:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:44:28.436520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908d1d7-5756-4162-bcc7-2a753a9e9eb4 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:28.437060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908d1d7-5756-4162-bcc7-2a753a9e9eb4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:28.437175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9908d1d7-5756-4162-bcc7-2a753a9e9eb4 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:28.438620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 698/1407] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:44:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:28.443860 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525aaaf-4452-4906-91dd-e1ed5c4bf1c9 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:28.444160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525aaaf-4452-4906-91dd-e1ed5c4bf1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:28.444483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525aaaf-4452-4906-91dd-e1ed5c4bf1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:28.464122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a525aaaf-4452-4906-91dd-e1ed5c4bf1c9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:28.465025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a525aaaf-4452-4906-91dd-e1ed5c4bf1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:28.473550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 710/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:28.518095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908d1d7-5756-4162-bcc7-2a753a9e9eb4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:28.536601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9908d1d7-5756-4162-bcc7-2a753a9e9eb4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:28.543291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a870b1-9649-402e-8628-c6594e158569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:28.544005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a870b1-9649-402e-8628-c6594e158569 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:28.544354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a870b1-9649-402e-8628-c6594e158569 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:28.544679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a870b1-9649-402e-8628-c6594e158569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:28.554843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a870b1-9649-402e-8628-c6594e158569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:28.556578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a870b1-9649-402e-8628-c6594e158569 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:28.569425 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 699/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:38.457879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=17 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:38.563760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=59 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:44:50.614620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f3419-3275-4e89-b3dc-45ecb115516c None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:50.615195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f3419-3275-4e89-b3dc-45ecb115516c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:50.615195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6f3419-3275-4e89-b3dc-45ecb115516c None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:50.616618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 711/1410] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jun 30 12:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:50.621729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed218-911b-401c-b1e0-537d2f1b71f2 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:50.622115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed218-911b-401c-b1e0-537d2f1b71f2 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:50.622291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ed218-911b-401c-b1e0-537d2f1b71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:50.641702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-4b4ed218-911b-401c-b1e0-537d2f1b71f2 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:50.644500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4b4ed218-911b-401c-b1e0-537d2f1b71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:50.652998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 700/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jun 30 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:50.667907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b43e-c987-4b84-8a02-d56c2550f3ea None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:50.668297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b43e-c987-4b84-8a02-d56c2550f3ea None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:50.668961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e94b43e-c987-4b84-8a02-d56c2550f3ea None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:50.670320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 712/1412] 10.222.0.20 () {54 vars in 918 bytes} [Thu Jun 30 12:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:50.675973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d44839-059c-40eb-8d4a-0965f2cabef7 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:50.676266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d44839-059c-40eb-8d4a-0965f2cabef7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:50.676578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d44839-059c-40eb-8d4a-0965f2cabef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:50.694947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-87d44839-059c-40eb-8d4a-0965f2cabef7 None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:50.696140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-87d44839-059c-40eb-8d4a-0965f2cabef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:50.705402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 701/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Thu Jun 30 12:44:50 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:53.315886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f79340-9b07-47f0-a55b-4503fc670956 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:53.316523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f79340-9b07-47f0-a55b-4503fc670956 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:53.316523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f79340-9b07-47f0-a55b-4503fc670956 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:53.317878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:53.323990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d9c9-51de-4058-b25e-f7c18eccd230 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:53.324596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d9c9-51de-4058-b25e-f7c18eccd230 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:53.324596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e810d9c9-51de-4058-b25e-f7c18eccd230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:53.344784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e810d9c9-51de-4058-b25e-f7c18eccd230 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:53.346218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e810d9c9-51de-4058-b25e-f7c18eccd230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:53.354369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:44:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:53.401536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f79340-9b07-47f0-a55b-4503fc670956 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:53.416473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f79340-9b07-47f0-a55b-4503fc670956 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:53.421903 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba68c09d-7087-4f6c-b057-ad923f2436ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:53.422541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68c09d-7087-4f6c-b057-ad923f2436ee service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:53.422826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68c09d-7087-4f6c-b057-ad923f2436ee service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:53.423101 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba68c09d-7087-4f6c-b057-ad923f2436ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:53.431722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68c09d-7087-4f6c-b057-ad923f2436ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:53.433334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba68c09d-7087-4f6c-b057-ad923f2436ee service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:53.443445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 714/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:54.376878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8986-bedf-4f2a-894a-b0165ade1c66 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:54.377931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8986-bedf-4f2a-894a-b0165ade1c66 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:54.377931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af8986-bedf-4f2a-894a-b0165ade1c66 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:54.378831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:44:54.383883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e2e6-5d11-44d7-ba48-f337f793eaaa None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:54.384315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e2e6-5d11-44d7-ba48-f337f793eaaa None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:54.384606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5122e2e6-5d11-44d7-ba48-f337f793eaaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:54.403720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5122e2e6-5d11-44d7-ba48-f337f793eaaa None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:54.404958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5122e2e6-5d11-44d7-ba48-f337f793eaaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:54.413443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:44:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:44:54.562519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af8986-bedf-4f2a-894a-b0165ade1c66 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:54.577434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af8986-bedf-4f2a-894a-b0165ade1c66 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:54.582778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa0e79c-9d0c-4724-bab8-cffc28c69f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:54.583416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e79c-9d0c-4724-bab8-cffc28c69f66 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:54.583704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e79c-9d0c-4724-bab8-cffc28c69f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:54.583982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa0e79c-9d0c-4724-bab8-cffc28c69f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:54.592029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e79c-9d0c-4724-bab8-cffc28c69f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:54.593664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa0e79c-9d0c-4724-bab8-cffc28c69f66 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:54.602894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 704/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:55.517514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4678e4-1296-4f5d-85e9-686c021d7dee None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:55.518049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4678e4-1296-4f5d-85e9-686c021d7dee None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:55.518140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4678e4-1296-4f5d-85e9-686c021d7dee None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:55.519530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:55.524985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89afe6-2e56-4868-8dbb-92d4aa4cae32 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:55.525400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89afe6-2e56-4868-8dbb-92d4aa4cae32 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:55.525587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89afe6-2e56-4868-8dbb-92d4aa4cae32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:55.543978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0f89afe6-2e56-4868-8dbb-92d4aa4cae32 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:55.545343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0f89afe6-2e56-4868-8dbb-92d4aa4cae32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:55.554721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:55.707166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4678e4-1296-4f5d-85e9-686c021d7dee None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:55.722805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4678e4-1296-4f5d-85e9-686c021d7dee None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:55.728427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87394e01-43cc-4df6-b493-cb097fa5631d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:55.729092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87394e01-43cc-4df6-b493-cb097fa5631d service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:55.729377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87394e01-43cc-4df6-b493-cb097fa5631d service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:55.729658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87394e01-43cc-4df6-b493-cb097fa5631d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:55.739448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87394e01-43cc-4df6-b493-cb097fa5631d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:55.741079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87394e01-43cc-4df6-b493-cb097fa5631d service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:55.750852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 717/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:56.640718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e86a37-6429-40e0-82da-35b92783e1ce None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:56.641170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e86a37-6429-40e0-82da-35b92783e1ce None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:56.641321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e86a37-6429-40e0-82da-35b92783e1ce None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:56.643700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:44:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:56.649097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc16f-177f-4e1d-bf5d-01b409bf1ed2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:56.649545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc16f-177f-4e1d-bf5d-01b409bf1ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:56.649663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cc16f-177f-4e1d-bf5d-01b409bf1ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:56.667824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-ca5cc16f-177f-4e1d-bf5d-01b409bf1ed2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:56.668585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ca5cc16f-177f-4e1d-bf5d-01b409bf1ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:56.677109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:44:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:56.855301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e86a37-6429-40e0-82da-35b92783e1ce None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:56.870906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e86a37-6429-40e0-82da-35b92783e1ce None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:56.876986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d4dbe-0d34-448d-a66b-167b66cbc61e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:56.877898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d4dbe-0d34-448d-a66b-167b66cbc61e service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:56.878195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d4dbe-0d34-448d-a66b-167b66cbc61e service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:56.878506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d4dbe-0d34-448d-a66b-167b66cbc61e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:56.887280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d4dbe-0d34-448d-a66b-167b66cbc61e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:56.888848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d4dbe-0d34-448d-a66b-167b66cbc61e service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:56.899256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 707/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:57.798277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db1eac-fa8b-42f8-bd4d-b92d8f1e4d91 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:57.799478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db1eac-fa8b-42f8-bd4d-b92d8f1e4d91 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:57.799478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1db1eac-fa8b-42f8-bd4d-b92d8f1e4d91 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:57.800202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:44:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:44:57.805366 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876be86-0ca3-4427-882e-308083edd3b7 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:57.805771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876be86-0ca3-4427-882e-308083edd3b7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:57.805940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876be86-0ca3-4427-882e-308083edd3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:57.824720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2876be86-0ca3-4427-882e-308083edd3b7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:57.825951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2876be86-0ca3-4427-882e-308083edd3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:57.834504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:44:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:57.988339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db1eac-fa8b-42f8-bd4d-b92d8f1e4d91 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:58.003837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1db1eac-fa8b-42f8-bd4d-b92d8f1e4d91 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:58.009422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef69c691-8bcb-47ad-8a1c-07aabf93118e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:58.010069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69c691-8bcb-47ad-8a1c-07aabf93118e service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:58.010359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69c691-8bcb-47ad-8a1c-07aabf93118e service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:58.010643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef69c691-8bcb-47ad-8a1c-07aabf93118e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:58.020633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69c691-8bcb-47ad-8a1c-07aabf93118e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:58.022239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef69c691-8bcb-47ad-8a1c-07aabf93118e service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:58.032148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 720/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:44:58.935878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e65fb-f223-494d-b61e-aa63021a3096 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:58.936481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e65fb-f223-494d-b61e-aa63021a3096 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:58.936587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3e65fb-f223-494d-b61e-aa63021a3096 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:58.938703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:44:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:44:58.946875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f48d0-de2b-491b-8979-94d3e7a0c46b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:58.947481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f48d0-de2b-491b-8979-94d3e7a0c46b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:58.947481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f48d0-de2b-491b-8979-94d3e7a0c46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:58.967695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a85f48d0-de2b-491b-8979-94d3e7a0c46b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:44:58.968946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a85f48d0-de2b-491b-8979-94d3e7a0c46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:44:58.977808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:44:59.139468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e65fb-f223-494d-b61e-aa63021a3096 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:44:59.154718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3e65fb-f223-494d-b61e-aa63021a3096 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:44:59.160893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f3e0fd-8b74-472a-a29a-57641a279fdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:44:59.161570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3e0fd-8b74-472a-a29a-57641a279fdc service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:44:59.161858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3e0fd-8b74-472a-a29a-57641a279fdc service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:44:59.162144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f3e0fd-8b74-472a-a29a-57641a279fdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:44:59.172031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3e0fd-8b74-472a-a29a-57641a279fdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:44:59.174302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f3e0fd-8b74-472a-a29a-57641a279fdc service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:44:59.184782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 710/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:44:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:00.034861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a8662-9bb0-4b58-bf54-17817d47e86a None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:00.035522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a8662-9bb0-4b58-bf54-17817d47e86a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:00.035522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6a8662-9bb0-4b58-bf54-17817d47e86a None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:00.036808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:45:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:00.041833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9432b4-911b-4df7-bdb2-f840567be2e8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:00.042288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9432b4-911b-4df7-bdb2-f840567be2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:00.042434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9432b4-911b-4df7-bdb2-f840567be2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:00.060359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0a9432b4-911b-4df7-bdb2-f840567be2e8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:00.061585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0a9432b4-911b-4df7-bdb2-f840567be2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:00.070075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:00.221686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a8662-9bb0-4b58-bf54-17817d47e86a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:00.235669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6a8662-9bb0-4b58-bf54-17817d47e86a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:00.241386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d089c-4f52-4088-b150-ab1cedbebccb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:00.242029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d089c-4f52-4088-b150-ab1cedbebccb service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:00.242321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d089c-4f52-4088-b150-ab1cedbebccb service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:00.242607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d089c-4f52-4088-b150-ab1cedbebccb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:00.251039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d089c-4f52-4088-b150-ab1cedbebccb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:00.253569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d089c-4f52-4088-b150-ab1cedbebccb service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:00.269028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 723/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:01.090374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a200-961f-4003-a7e5-8cda7d38398c None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:01.090953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a200-961f-4003-a7e5-8cda7d38398c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:01.090953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8a200-961f-4003-a7e5-8cda7d38398c None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:01.092432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:01.098531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9616a-08c2-4ae4-9fa4-cf0538bea35a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:01.099018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9616a-08c2-4ae4-9fa4-cf0538bea35a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:01.099120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b9616a-08c2-4ae4-9fa4-cf0538bea35a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:01.121074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e0b9616a-08c2-4ae4-9fa4-cf0538bea35a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:01.122290 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e0b9616a-08c2-4ae4-9fa4-cf0538bea35a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:01.131025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:45:01.285422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a200-961f-4003-a7e5-8cda7d38398c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:01.301064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8a200-961f-4003-a7e5-8cda7d38398c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:01.306368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9925226-008c-4c8f-82dd-60a374bc4587 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:01.307015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925226-008c-4c8f-82dd-60a374bc4587 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:01.307326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925226-008c-4c8f-82dd-60a374bc4587 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:01.307603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9925226-008c-4c8f-82dd-60a374bc4587 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:01.319892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925226-008c-4c8f-82dd-60a374bc4587 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:01.321537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9925226-008c-4c8f-82dd-60a374bc4587 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:01.331829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 713/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:02.183643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be4f28-6ec4-45e2-be0f-69ea96de36f8 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:02.184205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be4f28-6ec4-45e2-be0f-69ea96de36f8 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:02.184318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be4f28-6ec4-45e2-be0f-69ea96de36f8 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:02.185689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:45:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:02.191995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4928f3-4f00-4aaa-8113-f15d2ca9f192 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:02.192475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4928f3-4f00-4aaa-8113-f15d2ca9f192 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:02.192574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4928f3-4f00-4aaa-8113-f15d2ca9f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:02.210861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-bf4928f3-4f00-4aaa-8113-f15d2ca9f192 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:02.212080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bf4928f3-4f00-4aaa-8113-f15d2ca9f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:02.219906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:02.370013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be4f28-6ec4-45e2-be0f-69ea96de36f8 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:02.384868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be4f28-6ec4-45e2-be0f-69ea96de36f8 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:02.390684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606d45f-28fb-4a55-9898-499085efa0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:02.391319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d45f-28fb-4a55-9898-499085efa0ab service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:02.391624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d45f-28fb-4a55-9898-499085efa0ab service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:02.391911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606d45f-28fb-4a55-9898-499085efa0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:02.401012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606d45f-28fb-4a55-9898-499085efa0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:02.402585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606d45f-28fb-4a55-9898-499085efa0ab service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:02.412904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 726/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:04.369214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8d468-4e1e-4f19-af18-f9a04f4add75 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:04.369789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8d468-4e1e-4f19-af18-f9a04f4add75 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:04.369989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8d468-4e1e-4f19-af18-f9a04f4add75 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:04.371525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:04.377293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ac68-5091-40da-ba41-3d692f7ee153 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:04.377769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ac68-5091-40da-ba41-3d692f7ee153 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:04.377882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f164ac68-5091-40da-ba41-3d692f7ee153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:04.396421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f164ac68-5091-40da-ba41-3d692f7ee153 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:04.397631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f164ac68-5091-40da-ba41-3d692f7ee153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:04.406216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:04.447619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8d468-4e1e-4f19-af18-f9a04f4add75 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:04.449411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-99d8d468-4e1e-4f19-af18-f9a04f4add75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:04.464010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8d468-4e1e-4f19-af18-f9a04f4add75 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:04.468665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691e32d2-7d64-4ce1-80bc-0ad632ee53b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:04.469349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e32d2-7d64-4ce1-80bc-0ad632ee53b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:04.469635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e32d2-7d64-4ce1-80bc-0ad632ee53b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:04.469918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691e32d2-7d64-4ce1-80bc-0ad632ee53b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:04.480240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e32d2-7d64-4ce1-80bc-0ad632ee53b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:04.481732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691e32d2-7d64-4ce1-80bc-0ad632ee53b1 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:04.492444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 716/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:06.879656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a69a-cc9a-4349-8234-f541855f93ff None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:06.880188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a69a-cc9a-4349-8234-f541855f93ff None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:06.880188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a096a69a-cc9a-4349-8234-f541855f93ff None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:06.881608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:06.887308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edf30-ec52-425c-94eb-ffe260310463 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:06.887790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edf30-ec52-425c-94eb-ffe260310463 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:06.887883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549edf30-ec52-425c-94eb-ffe260310463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:06.906180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-549edf30-ec52-425c-94eb-ffe260310463 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:06.907403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-549edf30-ec52-425c-94eb-ffe260310463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:06.915936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:06.954276 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096a69a-cc9a-4349-8234-f541855f93ff None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:06.965849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a096a69a-cc9a-4349-8234-f541855f93ff None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:06.969455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c311fd74-3f03-4212-bb56-6a4e647ae8f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:06.970652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311fd74-3f03-4212-bb56-6a4e647ae8f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:06.971620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311fd74-3f03-4212-bb56-6a4e647ae8f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:06.971905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c311fd74-3f03-4212-bb56-6a4e647ae8f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:06.981544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311fd74-3f03-4212-bb56-6a4e647ae8f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:06.982980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c311fd74-3f03-4212-bb56-6a4e647ae8f4 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:06.993863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 729/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:09.437586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c355f-1cf4-4bed-8d9b-e52145e8bc4a None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:09.438154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c355f-1cf4-4bed-8d9b-e52145e8bc4a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:09.438154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91c355f-1cf4-4bed-8d9b-e52145e8bc4a None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:09.439601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:09.445643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f7421-5f95-485e-9ab2-d6beda282e87 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:09.446197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f7421-5f95-485e-9ab2-d6beda282e87 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:09.446197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f7421-5f95-485e-9ab2-d6beda282e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:09.465488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e28f7421-5f95-485e-9ab2-d6beda282e87 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:09.466917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e28f7421-5f95-485e-9ab2-d6beda282e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:09.475643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:09.515159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c355f-1cf4-4bed-8d9b-e52145e8bc4a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:09.526773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91c355f-1cf4-4bed-8d9b-e52145e8bc4a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:09.530296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7036d98-0dd6-41ad-960a-70b7cf3e101d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:09.530943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036d98-0dd6-41ad-960a-70b7cf3e101d service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:09.531227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036d98-0dd6-41ad-960a-70b7cf3e101d service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:09.531505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7036d98-0dd6-41ad-960a-70b7cf3e101d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:09.542261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036d98-0dd6-41ad-960a-70b7cf3e101d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:09.543700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7036d98-0dd6-41ad-960a-70b7cf3e101d service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:09.554339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 719/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:11.800858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355080f0-b19a-42b3-9084-61e7d6fc41cd None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:11.801435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355080f0-b19a-42b3-9084-61e7d6fc41cd None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:11.801546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355080f0-b19a-42b3-9084-61e7d6fc41cd None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:11.803149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:11.809152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc7ce-5875-4428-973e-3903fbbd949a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:11.809801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc7ce-5875-4428-973e-3903fbbd949a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:11.809801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ebc7ce-5875-4428-973e-3903fbbd949a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:11.828402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e9ebc7ce-5875-4428-973e-3903fbbd949a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:11.830276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e9ebc7ce-5875-4428-973e-3903fbbd949a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:11.838254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:11.878966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355080f0-b19a-42b3-9084-61e7d6fc41cd None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:11.890024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355080f0-b19a-42b3-9084-61e7d6fc41cd None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:11.894190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04151a09-3ed2-44ce-ba51-5a7514125369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:11.894844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151a09-3ed2-44ce-ba51-5a7514125369 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:11.895133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151a09-3ed2-44ce-ba51-5a7514125369 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:11.895423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04151a09-3ed2-44ce-ba51-5a7514125369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:11.905137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04151a09-3ed2-44ce-ba51-5a7514125369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:11.906576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04151a09-3ed2-44ce-ba51-5a7514125369 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:11.918204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 732/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:14.102143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f86d6e-a177-4c67-a356-c7b476b3ed0d None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:14.102686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f86d6e-a177-4c67-a356-c7b476b3ed0d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:14.102686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f86d6e-a177-4c67-a356-c7b476b3ed0d None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:14.104091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:14.109831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f594-599a-4e76-85ff-a9a0f82de8e2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:14.110270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f594-599a-4e76-85ff-a9a0f82de8e2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:14.110488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7598f594-599a-4e76-85ff-a9a0f82de8e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:14.130361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7598f594-599a-4e76-85ff-a9a0f82de8e2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:14.131580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7598f594-599a-4e76-85ff-a9a0f82de8e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:14.139620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:14.180480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f86d6e-a177-4c67-a356-c7b476b3ed0d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:14.192700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f86d6e-a177-4c67-a356-c7b476b3ed0d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:14.196236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0adc7-0a76-4704-bf0d-07e250e5e80d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:14.196944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0adc7-0a76-4704-bf0d-07e250e5e80d service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:14.197231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0adc7-0a76-4704-bf0d-07e250e5e80d service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:14.197514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0adc7-0a76-4704-bf0d-07e250e5e80d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:14.206799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0adc7-0a76-4704-bf0d-07e250e5e80d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:14.208277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0adc7-0a76-4704-bf0d-07e250e5e80d service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:14.217920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 722/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:16.504732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43027c-8389-43d3-8cd2-e13c7474a11c None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:16.505324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43027c-8389-43d3-8cd2-e13c7474a11c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:16.505324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43027c-8389-43d3-8cd2-e13c7474a11c None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:16.506652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:16.512547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0534-5992-4411-b5e9-6f8d7d92dfb1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:16.513066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0534-5992-4411-b5e9-6f8d7d92dfb1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:16.513200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b0534-5992-4411-b5e9-6f8d7d92dfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:16.533062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f78b0534-5992-4411-b5e9-6f8d7d92dfb1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:16.534411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f78b0534-5992-4411-b5e9-6f8d7d92dfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:16.542819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:16.585212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43027c-8389-43d3-8cd2-e13c7474a11c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:16.599196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43027c-8389-43d3-8cd2-e13c7474a11c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:16.603487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213bf644-c412-49d5-a4c0-9a66c8bba455 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:16.604215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf644-c412-49d5-a4c0-9a66c8bba455 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:16.604588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf644-c412-49d5-a4c0-9a66c8bba455 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:16.604915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213bf644-c412-49d5-a4c0-9a66c8bba455 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:16.616720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bf644-c412-49d5-a4c0-9a66c8bba455 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:16.618196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213bf644-c412-49d5-a4c0-9a66c8bba455 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:16.628927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 735/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:18.898744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa0b3-7cbb-4861-9de2-cae5277012ef None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:18.899300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa0b3-7cbb-4861-9de2-cae5277012ef None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:18.899300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195fa0b3-7cbb-4861-9de2-cae5277012ef None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:18.900751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:18.906205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005d76-ab66-4745-a571-a1b76ef1b62c None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:18.906707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005d76-ab66-4745-a571-a1b76ef1b62c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:18.906833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79005d76-ab66-4745-a571-a1b76ef1b62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:18.913427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=70 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:18.927936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-79005d76-ab66-4745-a571-a1b76ef1b62c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:18.929255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-79005d76-ab66-4745-a571-a1b76ef1b62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:18.937153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:18.977234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fa0b3-7cbb-4861-9de2-cae5277012ef None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:18.982924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=73 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:18.989980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195fa0b3-7cbb-4861-9de2-cae5277012ef None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:18.993557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28446bd7-6f74-4be8-b3a6-aa8c9f39052b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:18.994211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28446bd7-6f74-4be8-b3a6-aa8c9f39052b service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:18.994500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28446bd7-6f74-4be8-b3a6-aa8c9f39052b service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:18.994787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28446bd7-6f74-4be8-b3a6-aa8c9f39052b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:19.004294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28446bd7-6f74-4be8-b3a6-aa8c9f39052b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:19.005816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28446bd7-6f74-4be8-b3a6-aa8c9f39052b service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:19.016311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 725/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:21.196547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7252e-6e29-4f6e-ae2c-b02b06a740cb None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:21.197182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7252e-6e29-4f6e-ae2c-b02b06a740cb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:21.197182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab7252e-6e29-4f6e-ae2c-b02b06a740cb None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:21.198450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:21.204178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c0e30-c8b1-47de-9acb-ea296af5faec None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:21.205194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c0e30-c8b1-47de-9acb-ea296af5faec None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:21.205534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c0e30-c8b1-47de-9acb-ea296af5faec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:21.224467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-535c0e30-c8b1-47de-9acb-ea296af5faec None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:21.225700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-535c0e30-c8b1-47de-9acb-ea296af5faec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:21.233859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:21.274190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7252e-6e29-4f6e-ae2c-b02b06a740cb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:21.288011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab7252e-6e29-4f6e-ae2c-b02b06a740cb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:21.291781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3fba76-8418-468c-b104-fb4d1ae25b4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:21.292464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fba76-8418-468c-b104-fb4d1ae25b4c service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:21.292810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fba76-8418-468c-b104-fb4d1ae25b4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:21.293041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3fba76-8418-468c-b104-fb4d1ae25b4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:21.304136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fba76-8418-468c-b104-fb4d1ae25b4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:21.305627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3fba76-8418-468c-b104-fb4d1ae25b4c service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:21.317248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 738/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:23.431344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f2426-08bd-4ecd-9504-97b29080c00e None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:23.431853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f2426-08bd-4ecd-9504-97b29080c00e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:23.431965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f2426-08bd-4ecd-9504-97b29080c00e None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:23.433309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:23.439129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8e38-cbe5-4ae3-9afe-91e0c12f958f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:23.439592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8e38-cbe5-4ae3-9afe-91e0c12f958f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:23.439698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a8e38-cbe5-4ae3-9afe-91e0c12f958f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:23.457043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1a2a8e38-cbe5-4ae3-9afe-91e0c12f958f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:23.458234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1a2a8e38-cbe5-4ae3-9afe-91e0c12f958f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:23.466923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:23.505114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f2426-08bd-4ecd-9504-97b29080c00e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:23.515659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f2426-08bd-4ecd-9504-97b29080c00e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:23.521150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8231f57-92a5-4c9a-a880-5f2b2247c779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:23.522274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231f57-92a5-4c9a-a880-5f2b2247c779 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:23.522619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231f57-92a5-4c9a-a880-5f2b2247c779 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:23.522903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8231f57-92a5-4c9a-a880-5f2b2247c779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:23.534791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8231f57-92a5-4c9a-a880-5f2b2247c779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:23.537177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8231f57-92a5-4c9a-a880-5f2b2247c779 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:23.547205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 728/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:25.660910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4c20-031a-4031-920b-be8934c80e56 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:25.661769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4c20-031a-4031-920b-be8934c80e56 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:25.661769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0f4c20-031a-4031-920b-be8934c80e56 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:25.663423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:25.671437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22779e41-1baa-45aa-8c57-24bc887c573e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:25.672007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22779e41-1baa-45aa-8c57-24bc887c573e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:25.672007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22779e41-1baa-45aa-8c57-24bc887c573e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:25.692314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-22779e41-1baa-45aa-8c57-24bc887c573e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:25.693577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-22779e41-1baa-45aa-8c57-24bc887c573e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:25.701492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:45:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:25.741097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4c20-031a-4031-920b-be8934c80e56 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:25.752106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0f4c20-031a-4031-920b-be8934c80e56 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:25.755703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92166ba0-2306-4071-8e0b-1a00bba566b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:25.756353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92166ba0-2306-4071-8e0b-1a00bba566b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:25.756661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92166ba0-2306-4071-8e0b-1a00bba566b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:25.757009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92166ba0-2306-4071-8e0b-1a00bba566b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:25.766525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92166ba0-2306-4071-8e0b-1a00bba566b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:25.768416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92166ba0-2306-4071-8e0b-1a00bba566b9 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:25.778047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 741/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:35.686586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=17 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:35.773792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=17 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:45:48.058388 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b890fb9-c219-4ddb-8299-61518c68d9a8 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:48.058943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b890fb9-c219-4ddb-8299-61518c68d9a8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:48.058943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b890fb9-c219-4ddb-8299-61518c68d9a8 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:48.060349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 730/1471] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:45:48.067081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639639-b95a-4a5e-a499-aafe4a608418 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:48.067612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639639-b95a-4a5e-a499-aafe4a608418 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:48.067722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e639639-b95a-4a5e-a499-aafe4a608418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:48.086662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1e639639-b95a-4a5e-a499-aafe4a608418 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:48.087879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1e639639-b95a-4a5e-a499-aafe4a608418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:48.096983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 742/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:45:48.155332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d308e2-d5d1-42fd-b984-79eaf6aa20e2 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:48.155845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d308e2-d5d1-42fd-b984-79eaf6aa20e2 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:48.156476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d308e2-d5d1-42fd-b984-79eaf6aa20e2 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:48.159158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 731/1473] 10.222.0.20 () {54 vars in 962 bytes} [Thu Jun 30 12:45:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:48.164341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35175eb-1e29-496d-9710-647e037c56cd None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:48.164672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35175eb-1e29-496d-9710-647e037c56cd None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:48.164962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35175eb-1e29-496d-9710-647e037c56cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:48.185359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e35175eb-1e29-496d-9710-647e037c56cd None None] MFA Rules not processed for user `18e34e8f236f4f09a456e10221e2e416`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:48.187036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e35175eb-1e29-496d-9710-647e037c56cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:48.197904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 743/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Thu Jun 30 12:45:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:48.206155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d308e2-d5d1-42fd-b984-79eaf6aa20e2 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:48.219963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d308e2-d5d1-42fd-b984-79eaf6aa20e2 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:48.224224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df62974-0ef7-4133-9ba2-60561adfd23c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e34e8f236f4f09a456e10221e2e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:48.224978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62974-0ef7-4133-9ba2-60561adfd23c service glance] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:48.225353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62974-0ef7-4133-9ba2-60561adfd23c service glance] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:48.225637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df62974-0ef7-4133-9ba2-60561adfd23c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:48.235370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62974-0ef7-4133-9ba2-60561adfd23c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:48.236850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df62974-0ef7-4133-9ba2-60561adfd23c service glance] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:48.246722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 732/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:50.498311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e548-af2e-44b2-94ee-0729882af201 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:50.498933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e548-af2e-44b2-94ee-0729882af201 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:50.498933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8e548-af2e-44b2-94ee-0729882af201 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:50.500264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 744/1476] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:50.507008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdfbba-07cb-484f-8ee4-53d11e05045a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:50.507657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdfbba-07cb-484f-8ee4-53d11e05045a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:50.507657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bdfbba-07cb-484f-8ee4-53d11e05045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:50.530019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-29bdfbba-07cb-484f-8ee4-53d11e05045a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:50.531265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-29bdfbba-07cb-484f-8ee4-53d11e05045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:50.540089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 733/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:45:50.569225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e548-af2e-44b2-94ee-0729882af201 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:50.583512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8e548-af2e-44b2-94ee-0729882af201 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:50.591048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320f2de1-b534-4ad4-850c-08cc60ff7b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:50.592178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2de1-b534-4ad4-850c-08cc60ff7b61 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:50.592757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2de1-b534-4ad4-850c-08cc60ff7b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:50.593259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320f2de1-b534-4ad4-850c-08cc60ff7b61 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:50.595483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f2de1-b534-4ad4-850c-08cc60ff7b61 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:50.599095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-320f2de1-b534-4ad4-850c-08cc60ff7b61 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:45:50.599095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:45:50.599095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:45:50.601684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320f2de1-b534-4ad4-850c-08cc60ff7b61 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:50.627540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 745/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Thu Jun 30 12:45:50 2022] GET /identity/v3/projects => generated 2553 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:45:52.812211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f325-90ea-4cf2-9a93-2dbe87140dc5 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:52.812804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f325-90ea-4cf2-9a93-2dbe87140dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:52.812804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07f325-90ea-4cf2-9a93-2dbe87140dc5 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:52.814877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 734/1479] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:45:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:52.820453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2acd-94cc-4525-9c5a-67a355559f94 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:52.820917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2acd-94cc-4525-9c5a-67a355559f94 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:52.821017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363e2acd-94cc-4525-9c5a-67a355559f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:52.840108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-363e2acd-94cc-4525-9c5a-67a355559f94 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:52.841402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-363e2acd-94cc-4525-9c5a-67a355559f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:52.849493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 746/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:45:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:45:52.896014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f325-90ea-4cf2-9a93-2dbe87140dc5 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:52.913323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07f325-90ea-4cf2-9a93-2dbe87140dc5 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:52.918945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09bf354-e3e5-44d3-afea-d3d31d021ad0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:52.919603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf354-e3e5-44d3-afea-d3d31d021ad0 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:52.919895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf354-e3e5-44d3-afea-d3d31d021ad0 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:52.920180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09bf354-e3e5-44d3-afea-d3d31d021ad0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:52.930080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bf354-e3e5-44d3-afea-d3d31d021ad0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:52.931697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09bf354-e3e5-44d3-afea-d3d31d021ad0 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:52.941997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 735/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:55.337379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70eb0-b149-47e6-8b66-c4c2609a983f None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:55.337945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70eb0-b149-47e6-8b66-c4c2609a983f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:55.338418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e70eb0-b149-47e6-8b66-c4c2609a983f None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:55.341026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 747/1482] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:45:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:55.351430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e54b9-13a3-48d6-a9bb-24ce2f199147 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:55.352036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e54b9-13a3-48d6-a9bb-24ce2f199147 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:55.352036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241e54b9-13a3-48d6-a9bb-24ce2f199147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:55.371111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-241e54b9-13a3-48d6-a9bb-24ce2f199147 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:55.372399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-241e54b9-13a3-48d6-a9bb-24ce2f199147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:55.381011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 736/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:45:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:55.420578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70eb0-b149-47e6-8b66-c4c2609a983f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:55.431784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e70eb0-b149-47e6-8b66-c4c2609a983f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:55.435412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed237be-036e-41f7-b739-f89a36e686e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:55.436068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed237be-036e-41f7-b739-f89a36e686e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:55.436357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed237be-036e-41f7-b739-f89a36e686e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:55.436672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed237be-036e-41f7-b739-f89a36e686e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:55.447093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed237be-036e-41f7-b739-f89a36e686e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:55.448654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed237be-036e-41f7-b739-f89a36e686e3 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:55.460350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 748/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:45:57.701812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70bff0-51da-47a9-9413-1def2fc133ec None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:57.702333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70bff0-51da-47a9-9413-1def2fc133ec None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:57.702443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a70bff0-51da-47a9-9413-1def2fc133ec None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:57.704285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 737/1485] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:45:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:45:57.709957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9af86-94e0-4871-8edb-7bee11e3d7ca None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:57.710552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9af86-94e0-4871-8edb-7bee11e3d7ca None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:57.710552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9af86-94e0-4871-8edb-7bee11e3d7ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:57.730782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4dd9af86-94e0-4871-8edb-7bee11e3d7ca None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:45:57.732005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4dd9af86-94e0-4871-8edb-7bee11e3d7ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:45:57.740953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 749/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:45:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:45:57.780803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70bff0-51da-47a9-9413-1def2fc133ec None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:45:57.792939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a70bff0-51da-47a9-9413-1def2fc133ec None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:45:57.796624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ea16ef-8a1d-43cb-9ce2-ae7eb5ddffc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:45:57.797319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea16ef-8a1d-43cb-9ce2-ae7eb5ddffc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:45:57.797656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea16ef-8a1d-43cb-9ce2-ae7eb5ddffc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:45:57.797951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ea16ef-8a1d-43cb-9ce2-ae7eb5ddffc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:45:57.807917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea16ef-8a1d-43cb-9ce2-ae7eb5ddffc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:45:57.809517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ea16ef-8a1d-43cb-9ce2-ae7eb5ddffc8 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:45:57.821225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 738/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:45:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:46:00.173702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edcab5-412d-4ae9-9c3c-3f706d2a39c1 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:46:00.174274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edcab5-412d-4ae9-9c3c-3f706d2a39c1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:46:00.174375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9edcab5-412d-4ae9-9c3c-3f706d2a39c1 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:46:00.175675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 750/1488] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:46:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:46:00.181535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fac8b-b6fe-4492-ae3d-77a26a824514 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:46:00.182040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fac8b-b6fe-4492-ae3d-77a26a824514 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:46:00.182213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6fac8b-b6fe-4492-ae3d-77a26a824514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:46:00.201685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0d6fac8b-b6fe-4492-ae3d-77a26a824514 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:46:00.202913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0d6fac8b-b6fe-4492-ae3d-77a26a824514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:46:00.211130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 739/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:46:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:46:00.253706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edcab5-412d-4ae9-9c3c-3f706d2a39c1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:46:00.264689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9edcab5-412d-4ae9-9c3c-3f706d2a39c1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:46:00.268749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f2b341-1f19-4f4b-8e08-2d06bd34181e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:46:00.269405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b341-1f19-4f4b-8e08-2d06bd34181e service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:46:00.269686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b341-1f19-4f4b-8e08-2d06bd34181e service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:46:00.269958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2b341-1f19-4f4b-8e08-2d06bd34181e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:46:00.279951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2b341-1f19-4f4b-8e08-2d06bd34181e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:46:00.282028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f2b341-1f19-4f4b-8e08-2d06bd34181e service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:46:00.293297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 751/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:46:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:46:02.762404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199afa-b36f-4c3a-86b3-a104d07da3bc None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:46:02.763002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199afa-b36f-4c3a-86b3-a104d07da3bc None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:46:02.763002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be199afa-b36f-4c3a-86b3-a104d07da3bc None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:46:02.764335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 740/1491] 10.222.0.20 () {54 vars in 926 bytes} [Thu Jun 30 12:46:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:46:02.769936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc934-741d-4ad8-841f-c24e8445bb0c None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:46:02.770351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc934-741d-4ad8-841f-c24e8445bb0c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:46:02.770508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ddc934-741d-4ad8-841f-c24e8445bb0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:46:02.788022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-93ddc934-741d-4ad8-841f-c24e8445bb0c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:46:02.789263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-93ddc934-741d-4ad8-841f-c24e8445bb0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:46:02.797952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 752/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Thu Jun 30 12:46:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:46:02.842416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be199afa-b36f-4c3a-86b3-a104d07da3bc None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:46:02.858024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be199afa-b36f-4c3a-86b3-a104d07da3bc None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:46:02.862376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb7ef39-8f3f-45aa-9dde-1b3c1df7ec68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:46:02.863025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ef39-8f3f-45aa-9dde-1b3c1df7ec68 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:46:02.863308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ef39-8f3f-45aa-9dde-1b3c1df7ec68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:46:02.863586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb7ef39-8f3f-45aa-9dde-1b3c1df7ec68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:46:02.873267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7ef39-8f3f-45aa-9dde-1b3c1df7ec68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:46:02.874701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb7ef39-8f3f-45aa-9dde-1b3c1df7ec68 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:46:02.884737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 741/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:46:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:46:12.782926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=33 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:46:12.880609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=33 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:47:40.479934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac4668-bc45-4e15-81e7-24fcdc9cf364 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.480617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac4668-bc45-4e15-81e7-24fcdc9cf364 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.480740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac4668-bc45-4e15-81e7-24fcdc9cf364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.500748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-feac4668-bc45-4e15-81e7-24fcdc9cf364 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:47:40.501964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-feac4668-bc45-4e15-81e7-24fcdc9cf364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:47:40.509935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 753/1494] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:47:40.518394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a58eb-9050-4032-b3bc-23901fee1bc0 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.518926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a58eb-9050-4032-b3bc-23901fee1bc0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.519033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645a58eb-9050-4032-b3bc-23901fee1bc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.537851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-645a58eb-9050-4032-b3bc-23901fee1bc0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:47:40.539048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-645a58eb-9050-4032-b3bc-23901fee1bc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:47:40.547983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 742/1495] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:47:40.552543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac4668-bc45-4e15-81e7-24fcdc9cf364 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:40.562608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac4668-bc45-4e15-81e7-24fcdc9cf364 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:40.567395 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:40.568083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.568368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.568677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.569396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:47:40.569712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:40.570726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:40.570726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:47:40.570726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:47:40.571651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:40.583804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 754/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:47:40.591786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a58eb-9050-4032-b3bc-23901fee1bc0 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:40.601977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645a58eb-9050-4032-b3bc-23901fee1bc0 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:40.606526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:40.607174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.607461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.607743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.609587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:40.611389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING py.warnings [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:40.611389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: warnings.warn(msg) Jun 30 12:47:40.611389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: Jun 30 12:47:40.612607 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:40.652485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 743/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:47:40 2022] POST /identity/v3/projects => generated 379 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:47:40.653671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:40.664544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4d184-14ec-4424-876d-64be1e22f79b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:40.721620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:40.722298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.722590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.722875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.723564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:40.724612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:40.724612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:47:40.724612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:47:40.725836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:40.747716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 755/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:47:40 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:47:40.751969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:40.762417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f863e-4735-4d41-a1e7-fe221052c67f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:40.767584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:40.768253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.768573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.768885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.769876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:40.770896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING py.warnings [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:40.770896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: warnings.warn(msg) Jun 30 12:47:40.770896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: Jun 30 12:47:40.771786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:40.785050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 744/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:47:40.789184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:40.799752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f94a00-e0e3-4bd2-a1ff-91b6770281ff admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:40.804416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c1373-288c-4eee-8297-ebb7a61b4e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:40.805150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c1373-288c-4eee-8297-ebb7a61b4e60 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.805440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c1373-288c-4eee-8297-ebb7a61b4e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.805725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c1373-288c-4eee-8297-ebb7a61b4e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.806453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c1373-288c-4eee-8297-ebb7a61b4e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:40.807495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-740c1373-288c-4eee-8297-ebb7a61b4e60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:40.807495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:47:40.807495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:47:40.808409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c1373-288c-4eee-8297-ebb7a61b4e60 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:40.822279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 756/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:47:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:47:40.826485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:40.836351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df18afd-50f3-41b9-8338-08010e409ea2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:40.840927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73ba96b-948e-4b28-b24e-45adbccc6a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:40.841812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ba96b-948e-4b28-b24e-45adbccc6a2c admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.842101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ba96b-948e-4b28-b24e-45adbccc6a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.842387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73ba96b-948e-4b28-b24e-45adbccc6a2c admin admin] PATH_INFO: `/v3/projects/b2466e1e508c4d998a23082ad623f6b6/users/164e5c3320f143a48bcd76645a3298f6/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.858928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ba96b-948e-4b28-b24e-45adbccc6a2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2466e1e508c4d998a23082ad623f6b6, user_id=164e5c3320f143a48bcd76645a3298f6, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:40.860145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING py.warnings [None req-b73ba96b-948e-4b28-b24e-45adbccc6a2c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:40.860145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: warnings.warn(msg) Jun 30 12:47:40.860145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: Jun 30 12:47:40.862121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73ba96b-948e-4b28-b24e-45adbccc6a2c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:40.875156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 745/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:47:40 2022] PUT /identity/v3/projects/b2466e1e508c4d998a23082ad623f6b6/users/164e5c3320f143a48bcd76645a3298f6/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:47:40.887197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad1c18-f436-4de6-8c3a-796172b1c825 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.887475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad1c18-f436-4de6-8c3a-796172b1c825 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.887759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad1c18-f436-4de6-8c3a-796172b1c825 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.915270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-76ad1c18-f436-4de6-8c3a-796172b1c825 None None] MFA Rules not processed for user `164e5c3320f143a48bcd76645a3298f6`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:47:40.916547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-76ad1c18-f436-4de6-8c3a-796172b1c825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:47:40.979879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 757/1502] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:47:40.993066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beee4d-b7d7-42d7-aff5-24271485c0fd None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:40.993361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beee4d-b7d7-42d7-aff5-24271485c0fd None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:40.993647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0beee4d-b7d7-42d7-aff5-24271485c0fd None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:40.995037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 746/1503] 10.222.0.20 () {54 vars in 963 bytes} [Thu Jun 30 12:47:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:47:40.999815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871625d-4b1f-480e-bd70-c95a847abe4d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:41.000058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871625d-4b1f-480e-bd70-c95a847abe4d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:41.000343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f871625d-4b1f-480e-bd70-c95a847abe4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:41.018330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f871625d-4b1f-480e-bd70-c95a847abe4d None None] MFA Rules not processed for user `6290142aced542e19cc4b23ab34a3d03`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:47:41.019860 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f871625d-4b1f-480e-bd70-c95a847abe4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:47:41.071448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:47:41.080887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 758/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Thu Jun 30 12:47:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:47:41.088442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beee4d-b7d7-42d7-aff5-24271485c0fd None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:41.100773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0beee4d-b7d7-42d7-aff5-24271485c0fd None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:41.104311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:41.104991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:41.105281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:41.105562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:41.114149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:41.115595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:41.124724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 747/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:47:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:47:41.167609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01a268-4f33-471d-9d37-63a1a91ed6b6 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:41.167904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01a268-4f33-471d-9d37-63a1a91ed6b6 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:41.168188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01a268-4f33-471d-9d37-63a1a91ed6b6 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:41.169494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 759/1506] 10.222.0.20 () {52 vars in 829 bytes} [Thu Jun 30 12:47:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:47:41.173568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:41.234552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040620b-d635-4754-a6dc-9e8961cabe15 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:41.239043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:41.239906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:41.240187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:41.240493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] PATH_INFO: `/v3/users/164e5c3320f143a48bcd76645a3298f6` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:41.241672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=164e5c3320f143a48bcd76645a3298f6)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:41.242687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING py.warnings [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:41.242687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: warnings.warn(msg) Jun 30 12:47:41.242687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: Jun 30 12:47:41.243878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:41.308606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164e5c3320f143a48bcd76645a3298f6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:41.319934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164e5c3320f143a48bcd76645a3298f6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:41.320663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164e5c3320f143a48bcd76645a3298f6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:41.321436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164e5c3320f143a48bcd76645a3298f6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:41.340657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164e5c3320f143a48bcd76645a3298f6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:41.349779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:47:41.362418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 748/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:47:41 2022] DELETE /identity/v3/users/164e5c3320f143a48bcd76645a3298f6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:47:41.366931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:41.367329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:41.367620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:41.386347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:47:41.387579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:47:41.449817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 760/1508] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:47:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:47:41.460166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:41.461656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:47:41.521071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916cfb2e-ab95-4830-bf89-da49a9e9dd58 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:41.525282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc31ecf-7b03-4c61-a624-38f08a700ad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:41.525947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31ecf-7b03-4c61-a624-38f08a700ad1 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:41.526231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31ecf-7b03-4c61-a624-38f08a700ad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:41.526509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc31ecf-7b03-4c61-a624-38f08a700ad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:41.535406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc31ecf-7b03-4c61-a624-38f08a700ad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:41.537099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc31ecf-7b03-4c61-a624-38f08a700ad1 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:41.547332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 749/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:47:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:47:41.894391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:47:41.896511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:47:41.908974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da8513-d9a1-42f1-aa81-743817612228 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:47:41.913793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:47:41.914693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:47:41.914984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:47:41.915284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] PATH_INFO: `/v3/projects/b2466e1e508c4d998a23082ad623f6b6` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:47:41.916556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2466e1e508c4d998a23082ad623f6b6)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:47:41.917588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:47:41.917588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:47:41.917588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:47:41.918837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:47:41.980150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2466e1e508c4d998a23082ad623f6b6', 'request_id': 'req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:41.989586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2466e1e508c4d998a23082ad623f6b6', 'request_id': 'req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:41.995679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2466e1e508c4d998a23082ad623f6b6', 'request_id': 'req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:42.014468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] The token cache is being invalidate because project b2466e1e508c4d998a23082ad623f6b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:47:42.014764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:42.015433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f28c25f-8cc8-47b7-9d2e-22cab0f977dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:47:42.017105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 761/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:47:41 2022] DELETE /identity/v3/projects/b2466e1e508c4d998a23082ad623f6b6 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:47:51.543081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=29 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:47:52.011393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:49:25.142482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475ffe-81ca-4d3f-af4d-15411f397316 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:25.143073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475ffe-81ca-4d3f-af4d-15411f397316 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:25.143073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60475ffe-81ca-4d3f-af4d-15411f397316 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:25.144472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:49:25.149641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00646560-3a9d-479f-b72a-44b97f75ad12 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:25.150049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00646560-3a9d-479f-b72a-44b97f75ad12 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:25.150208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00646560-3a9d-479f-b72a-44b97f75ad12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:25.168299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-00646560-3a9d-479f-b72a-44b97f75ad12 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:25.169576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-00646560-3a9d-479f-b72a-44b97f75ad12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:25.230199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:49:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:25.398693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475ffe-81ca-4d3f-af4d-15411f397316 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:25.400396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-60475ffe-81ca-4d3f-af4d-15411f397316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:25.474484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60475ffe-81ca-4d3f-af4d-15411f397316 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:25.479879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e7bf7-a93d-4492-b89c-c4b933604f66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:25.480593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7bf7-a93d-4492-b89c-c4b933604f66 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:25.480886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7bf7-a93d-4492-b89c-c4b933604f66 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:25.481169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e7bf7-a93d-4492-b89c-c4b933604f66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:25.489928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e7bf7-a93d-4492-b89c-c4b933604f66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:25.491519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e7bf7-a93d-4492-b89c-c4b933604f66 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:25.501847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 751/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:26.346824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3431d9-0af3-4269-b069-597cad0d5ce0 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:26.347374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3431d9-0af3-4269-b069-597cad0d5ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:26.347374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3431d9-0af3-4269-b069-597cad0d5ce0 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:26.348841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:49:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:49:26.353662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb67c1-2322-43f9-a4c4-54ba2ac45403 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:26.354060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb67c1-2322-43f9-a4c4-54ba2ac45403 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:26.354237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb67c1-2322-43f9-a4c4-54ba2ac45403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:26.377150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-dfcb67c1-2322-43f9-a4c4-54ba2ac45403 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:26.378360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-dfcb67c1-2322-43f9-a4c4-54ba2ac45403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:26.386242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:26.544089 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3431d9-0af3-4269-b069-597cad0d5ce0 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:26.558699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3431d9-0af3-4269-b069-597cad0d5ce0 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:26.564136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e639a85c-58df-438b-9e37-593355b7950d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:26.564815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a85c-58df-438b-9e37-593355b7950d service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:26.565110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a85c-58df-438b-9e37-593355b7950d service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:26.565398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e639a85c-58df-438b-9e37-593355b7950d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:26.573699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639a85c-58df-438b-9e37-593355b7950d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:26.575292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e639a85c-58df-438b-9e37-593355b7950d service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:26.585910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 764/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:26.898115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450aecf-70ee-4ff3-9f3b-7b0ee557ead3 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:26.898311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450aecf-70ee-4ff3-9f3b-7b0ee557ead3 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:26.898597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c450aecf-70ee-4ff3-9f3b-7b0ee557ead3 None None] PATH_INFO: `/v3` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:26.899914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 753/1517] 10.222.0.67 () {54 vars in 925 bytes} [Thu Jun 30 12:49:26 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:49:26.906573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46be8-49ae-449b-a82e-e2ad97396e67 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:26.906865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46be8-49ae-449b-a82e-e2ad97396e67 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:26.907145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d46be8-49ae-449b-a82e-e2ad97396e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:26.924902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-91d46be8-49ae-449b-a82e-e2ad97396e67 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:26.926104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-91d46be8-49ae-449b-a82e-e2ad97396e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:26.991721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 765/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jun 30 12:49:26 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:35.742771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a6454-903a-4196-be07-0c8c8d8a883a None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:35.743359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a6454-903a-4196-be07-0c8c8d8a883a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:35.743359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1a6454-903a-4196-be07-0c8c8d8a883a None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:35.744971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 754/1519] 10.222.0.20 () {54 vars in 960 bytes} [Thu Jun 30 12:49:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 30 12:49:35.751349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7ee7-7a10-4ac9-acc9-8bbae11d250f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:35.751893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7ee7-7a10-4ac9-acc9-8bbae11d250f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:35.752061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a7ee7-7a10-4ac9-acc9-8bbae11d250f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:35.773754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-888a7ee7-7a10-4ac9-acc9-8bbae11d250f None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:35.774997 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-888a7ee7-7a10-4ac9-acc9-8bbae11d250f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:35.784596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 766/1520] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Jun 30 12:49:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:35.792512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a6454-903a-4196-be07-0c8c8d8a883a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:35.806586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1a6454-903a-4196-be07-0c8c8d8a883a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:35.811993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6798bb15-5d12-4cba-9bab-d0d6eb85d1dc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:35.812649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bb15-5d12-4cba-9bab-d0d6eb85d1dc service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:35.814494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bb15-5d12-4cba-9bab-d0d6eb85d1dc service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:35.814494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bb15-5d12-4cba-9bab-d0d6eb85d1dc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:35.822833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798bb15-5d12-4cba-9bab-d0d6eb85d1dc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:35.824448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6798bb15-5d12-4cba-9bab-d0d6eb85d1dc service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:35.835979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 755/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:37.864232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514d46-0f03-42b9-a6a8-5854460d84ce None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:37.864820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514d46-0f03-42b9-a6a8-5854460d84ce None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:37.864820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67514d46-0f03-42b9-a6a8-5854460d84ce None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:37.866255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:49:37.871194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25baca-de6f-47cb-8a31-785942a880f1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:37.871609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25baca-de6f-47cb-8a31-785942a880f1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:37.871792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de25baca-de6f-47cb-8a31-785942a880f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:37.891221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-de25baca-de6f-47cb-8a31-785942a880f1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:37.892465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-de25baca-de6f-47cb-8a31-785942a880f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:37.900579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:49:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:38.056227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67514d46-0f03-42b9-a6a8-5854460d84ce None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:38.071821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67514d46-0f03-42b9-a6a8-5854460d84ce None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:38.077756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472cc91f-bde0-45e7-ae0d-e59b1394466c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:38.078384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc91f-bde0-45e7-ae0d-e59b1394466c service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:38.078668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc91f-bde0-45e7-ae0d-e59b1394466c service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:38.078943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472cc91f-bde0-45e7-ae0d-e59b1394466c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:38.087022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cc91f-bde0-45e7-ae0d-e59b1394466c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:38.088670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472cc91f-bde0-45e7-ae0d-e59b1394466c service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:38.098952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 768/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:38.963258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0d4c-581a-4af1-b579-901b54a5c360 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:38.963772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0d4c-581a-4af1-b579-901b54a5c360 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:38.963772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1c0d4c-581a-4af1-b579-901b54a5c360 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:38.965148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 30 12:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:49:38.970009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbfa7-a5bf-4be9-86fc-edefc90ab186 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:38.970406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbfa7-a5bf-4be9-86fc-edefc90ab186 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:38.970568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511fbfa7-a5bf-4be9-86fc-edefc90ab186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:38.988777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-511fbfa7-a5bf-4be9-86fc-edefc90ab186 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:38.989985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-511fbfa7-a5bf-4be9-86fc-edefc90ab186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:38.998465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 30 12:49:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:39.150565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c0d4c-581a-4af1-b579-901b54a5c360 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:39.165599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1c0d4c-581a-4af1-b579-901b54a5c360 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:39.171065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf7b31-51f2-4eb6-85aa-15116d62afab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:39.171698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf7b31-51f2-4eb6-85aa-15116d62afab service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:39.171987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf7b31-51f2-4eb6-85aa-15116d62afab service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:39.172271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf7b31-51f2-4eb6-85aa-15116d62afab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:39.180425 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf7b31-51f2-4eb6-85aa-15116d62afab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:39.182028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cf7b31-51f2-4eb6-85aa-15116d62afab service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:39.191436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 758/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:43.138571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc57c-4ab1-43e5-821c-dd9b5bb63263 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:43.139822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc57c-4ab1-43e5-821c-dd9b5bb63263 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:43.139822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56dc57c-4ab1-43e5-821c-dd9b5bb63263 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:43.140768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:49:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:49:43.149178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4aa21-ccd9-49c5-8434-6c37464de652 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:43.149826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4aa21-ccd9-49c5-8434-6c37464de652 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:43.149826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f4aa21-ccd9-49c5-8434-6c37464de652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:43.168355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-15f4aa21-ccd9-49c5-8434-6c37464de652 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:43.169603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-15f4aa21-ccd9-49c5-8434-6c37464de652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:43.179444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:49:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:43.219648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dc57c-4ab1-43e5-821c-dd9b5bb63263 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:43.221463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b56dc57c-4ab1-43e5-821c-dd9b5bb63263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:43.285848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56dc57c-4ab1-43e5-821c-dd9b5bb63263 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:43.289364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53f8b7-ed79-44cf-8f6c-36681f3d701a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:43.290025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53f8b7-ed79-44cf-8f6c-36681f3d701a service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:43.290309 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53f8b7-ed79-44cf-8f6c-36681f3d701a service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:43.290587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53f8b7-ed79-44cf-8f6c-36681f3d701a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:43.300644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53f8b7-ed79-44cf-8f6c-36681f3d701a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:43.302074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53f8b7-ed79-44cf-8f6c-36681f3d701a service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:43.306867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:49:43.311987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 771/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:45.367121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a97f-77c8-4c38-9d23-1b237cba1f7b None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:45.367770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a97f-77c8-4c38-9d23-1b237cba1f7b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:45.367770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216a97f-77c8-4c38-9d23-1b237cba1f7b None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:45.369333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:49:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:49:45.376845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7f2c-b7d1-4e06-887a-b40565071bd0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:45.377533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7f2c-b7d1-4e06-887a-b40565071bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:45.377533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4c7f2c-b7d1-4e06-887a-b40565071bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:45.397998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-de4c7f2c-b7d1-4e06-887a-b40565071bd0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:45.399217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-de4c7f2c-b7d1-4e06-887a-b40565071bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:45.408041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:49:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:49:45.446454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a97f-77c8-4c38-9d23-1b237cba1f7b None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:45.460891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216a97f-77c8-4c38-9d23-1b237cba1f7b None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:45.464410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92e200-0684-433d-b630-b41e907969fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:45.465063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e200-0684-433d-b630-b41e907969fe service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:45.465349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e200-0684-433d-b630-b41e907969fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:45.465625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92e200-0684-433d-b630-b41e907969fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:45.476244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92e200-0684-433d-b630-b41e907969fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:45.477845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92e200-0684-433d-b630-b41e907969fe service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:45.487889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 761/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:49.091151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a024-1eed-4db9-bf32-2617eabb1f58 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:49.091688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a024-1eed-4db9-bf32-2617eabb1f58 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:49.091781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b6a024-1eed-4db9-bf32-2617eabb1f58 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:49.093951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:49:49.099372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b86a-9545-4f3c-a171-995020bdc0a8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:49.099842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b86a-9545-4f3c-a171-995020bdc0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:49.099967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479b86a-9545-4f3c-a171-995020bdc0a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:49.117819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b479b86a-9545-4f3c-a171-995020bdc0a8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:49.119031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b479b86a-9545-4f3c-a171-995020bdc0a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:49.127505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:49:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:49.455838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a024-1eed-4db9-bf32-2617eabb1f58 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:49.457619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c2b6a024-1eed-4db9-bf32-2617eabb1f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:49.521129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b6a024-1eed-4db9-bf32-2617eabb1f58 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:49.524883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1515ed-0a45-48a2-affd-d25b453b1ba2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:49.525552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1515ed-0a45-48a2-affd-d25b453b1ba2 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:49.525839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1515ed-0a45-48a2-affd-d25b453b1ba2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:49.526121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1515ed-0a45-48a2-affd-d25b453b1ba2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:49.537556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1515ed-0a45-48a2-affd-d25b453b1ba2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:49.539021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1515ed-0a45-48a2-affd-d25b453b1ba2 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:49.550272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 774/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:49:51.707049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100548fe-4f22-462a-b189-3c27abd686cb None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:51.707560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100548fe-4f22-462a-b189-3c27abd686cb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:51.707664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100548fe-4f22-462a-b189-3c27abd686cb None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:51.709091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 30 12:49:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:49:51.714720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f20829-d542-4030-ba73-99dc45719f77 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:51.715194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f20829-d542-4030-ba73-99dc45719f77 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:51.715300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f20829-d542-4030-ba73-99dc45719f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:51.734554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-51f20829-d542-4030-ba73-99dc45719f77 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:49:51.735760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-51f20829-d542-4030-ba73-99dc45719f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:51.743603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 30 12:49:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:49:52.062932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100548fe-4f22-462a-b189-3c27abd686cb None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:49:52.064667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-100548fe-4f22-462a-b189-3c27abd686cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:49:52.072298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=65 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:49:52.078774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100548fe-4f22-462a-b189-3c27abd686cb None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:49:52.082385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20233d48-ddf1-4a43-84f5-68e1ce0dd56b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:49:52.083031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20233d48-ddf1-4a43-84f5-68e1ce0dd56b service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:49:52.083426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20233d48-ddf1-4a43-84f5-68e1ce0dd56b service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:49:52.083606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20233d48-ddf1-4a43-84f5-68e1ce0dd56b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:49:52.093671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20233d48-ddf1-4a43-84f5-68e1ce0dd56b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:49:52.095126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20233d48-ddf1-4a43-84f5-68e1ce0dd56b service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:49:52.105158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 764/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:49:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:50:01.728256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=32 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:50:02.100666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:24.912257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdb3bc-fe70-44db-a746-5f08c3b295b9 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:24.912983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdb3bc-fe70-44db-a746-5f08c3b295b9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:24.912983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfdb3bc-fe70-44db-a746-5f08c3b295b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:24.938833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-fbfdb3bc-fe70-44db-a746-5f08c3b295b9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:24.940073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-fbfdb3bc-fe70-44db-a746-5f08c3b295b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:24.955216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c18c-be5d-4ce2-8f34-adb674dddc60 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:24.955784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c18c-be5d-4ce2-8f34-adb674dddc60 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:24.955784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22c18c-be5d-4ce2-8f34-adb674dddc60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:24.957039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 776/1540] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:24.966490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb48a-ab71-4579-8d6c-f7175a4361ff None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:24.966843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb48a-ab71-4579-8d6c-f7175a4361ff None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:24.967057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0bb48a-ab71-4579-8d6c-f7175a4361ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:24.990406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ce22c18c-be5d-4ce2-8f34-adb674dddc60 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:24.991803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ce22c18c-be5d-4ce2-8f34-adb674dddc60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:24.992703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3e0bb48a-ab71-4579-8d6c-f7175a4361ff None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:24.993904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3e0bb48a-ab71-4579-8d6c-f7175a4361ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.005778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 765/1541] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.010328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 777/1542] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:51:25.015625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4f00-5919-4f39-8adb-3bc883231dad None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.015810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb48a-ab71-4579-8d6c-f7175a4361ff None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.015912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4f00-5919-4f39-8adb-3bc883231dad None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.016187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e4f00-5919-4f39-8adb-3bc883231dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.028743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0bb48a-ab71-4579-8d6c-f7175a4361ff None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.037467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.037864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0c2e4f00-5919-4f39-8adb-3bc883231dad None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.038161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.038448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.038726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.039092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0c2e4f00-5919-4f39-8adb-3bc883231dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.039477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:25.039791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.041467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.052904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 766/1543] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.058342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4f00-5919-4f39-8adb-3bc883231dad None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.071016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 778/1544] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:51:25.074453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e4f00-5919-4f39-8adb-3bc883231dad None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.079785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.080123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.080497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.080788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.081066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.081811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:25.082124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.089620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING py.warnings [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:51:25.089620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: warnings.warn(msg) Jun 30 12:51:25.089620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: Jun 30 12:51:25.090640 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.111019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc643104-eef1-4480-b83f-778e79ead031 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.114998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 767/1545] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:51:25.123765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.129733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.130442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.130731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.131011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.131731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.132796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:51:25.132796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:51:25.132796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:51:25.134005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.142867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c92f117-64dc-4ee3-b724-f88e176f6385 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.155106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.155818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.156109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.156407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.157138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.159261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.215445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 779/1546] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/projects => generated 375 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:51:25.218138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 768/1547] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/projects => generated 389 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:25.220007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.222257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.313452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff1d972-b5d3-4f9f-8b42-395632bb36f2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.324500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc8c5cf-282a-458f-8e9c-7b7efe2db23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.325369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c5cf-282a-458f-8e9c-7b7efe2db23b admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.325862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c5cf-282a-458f-8e9c-7b7efe2db23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.326663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc8c5cf-282a-458f-8e9c-7b7efe2db23b admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.327585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8c5cf-282a-458f-8e9c-7b7efe2db23b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.331369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING py.warnings [None req-1cc8c5cf-282a-458f-8e9c-7b7efe2db23b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:51:25.331369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: warnings.warn(msg) Jun 30 12:51:25.331369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: Jun 30 12:51:25.332905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc8c5cf-282a-458f-8e9c-7b7efe2db23b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.369861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 769/1548] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:51:25.371432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa679425-2581-4552-9d43-c0da0a42512f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.371728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa679425-2581-4552-9d43-c0da0a42512f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.373813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa679425-2581-4552-9d43-c0da0a42512f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.393057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4da902-637d-40af-ba54-fe4512dea322 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.399574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b22f52a-f309-49d6-9b2e-ef8895167802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.400271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f52a-f309-49d6-9b2e-ef8895167802 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.400592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f52a-f309-49d6-9b2e-ef8895167802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.400875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b22f52a-f309-49d6-9b2e-ef8895167802 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.401578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f52a-f309-49d6-9b2e-ef8895167802 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.403694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-fa679425-2581-4552-9d43-c0da0a42512f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.404352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b22f52a-f309-49d6-9b2e-ef8895167802 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.405057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fa679425-2581-4552-9d43-c0da0a42512f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.414941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 770/1549] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.416051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa679425-2581-4552-9d43-c0da0a42512f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.429210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa679425-2581-4552-9d43-c0da0a42512f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.438384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 780/1550] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/users => generated 288 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:25.441835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929657-eec8-4781-9926-dbce18847313 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.442713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db435e9-7c38-4a1f-b036-03cf958aef59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.443516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db435e9-7c38-4a1f-b036-03cf958aef59 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.443814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db435e9-7c38-4a1f-b036-03cf958aef59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.444095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db435e9-7c38-4a1f-b036-03cf958aef59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.444725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929657-eec8-4781-9926-dbce18847313 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.445022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53929657-eec8-4781-9926-dbce18847313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.445937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db435e9-7c38-4a1f-b036-03cf958aef59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.447394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db435e9-7c38-4a1f-b036-03cf958aef59 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.458974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 771/1551] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:25.460523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86468028-e4c7-4320-bd70-635c415806da None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.460826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86468028-e4c7-4320-bd70-635c415806da None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.461117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86468028-e4c7-4320-bd70-635c415806da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.469958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-53929657-eec8-4781-9926-dbce18847313 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.471117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-53929657-eec8-4781-9926-dbce18847313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.479886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 781/1552] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.484671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-86468028-e4c7-4320-bd70-635c415806da None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.484797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c2d9-cd5a-49aa-bd6f-cc58d70d873b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.484797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c2d9-cd5a-49aa-bd6f-cc58d70d873b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.484997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-86468028-e4c7-4320-bd70-635c415806da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.485099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a18c2d9-cd5a-49aa-bd6f-cc58d70d873b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.493875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 772/1553] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.495880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a083e-9a18-4107-8fe4-e0afd4365cdf None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.496260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a083e-9a18-4107-8fe4-e0afd4365cdf None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.496593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a083e-9a18-4107-8fe4-e0afd4365cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.502510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7a18c2d9-cd5a-49aa-bd6f-cc58d70d873b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.504082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7a18c2d9-cd5a-49aa-bd6f-cc58d70d873b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.513891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 782/1554] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.516145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c2d9-cd5a-49aa-bd6f-cc58d70d873b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.521768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-827a083e-9a18-4107-8fe4-e0afd4365cdf None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.523145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-827a083e-9a18-4107-8fe4-e0afd4365cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.525685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a18c2d9-cd5a-49aa-bd6f-cc58d70d873b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.531376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.532042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.532294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.532590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.533322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.533435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 773/1555] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.534890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4a3b-7a76-47f0-9be7-b6bcd58689e4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.535188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4a3b-7a76-47f0-9be7-b6bcd58689e4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.535476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fa4a3b-7a76-47f0-9be7-b6bcd58689e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.538182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.551930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 783/1556] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:25.551930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.554781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-90fa4a3b-7a76-47f0-9be7-b6bcd58689e4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.556016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-90fa4a3b-7a76-47f0-9be7-b6bcd58689e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.560722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05db06c-8531-4343-b6ae-54708c5ca2f6 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.564193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 774/1557] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.565577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073514-841e-4f85-a2a7-0994fe438138 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.565865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622f7aac-9b8d-47fa-819a-55b623233ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.566008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073514-841e-4f85-a2a7-0994fe438138 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.566148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073514-841e-4f85-a2a7-0994fe438138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.566791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7aac-9b8d-47fa-819a-55b623233ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.567219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7aac-9b8d-47fa-819a-55b623233ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.567593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622f7aac-9b8d-47fa-819a-55b623233ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.568450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f7aac-9b8d-47fa-819a-55b623233ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.570146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622f7aac-9b8d-47fa-819a-55b623233ad8 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.586157 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7b073514-841e-4f85-a2a7-0994fe438138 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.587278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 784/1558] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:25.587410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7b073514-841e-4f85-a2a7-0994fe438138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.588822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e4aa-013f-4357-afdc-8d318f33bcdb None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.589119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e4aa-013f-4357-afdc-8d318f33bcdb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.589402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44e4aa-013f-4357-afdc-8d318f33bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.599139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 775/1559] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.600581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bd1f-0c0f-40df-96c0-5ccc408b5b07 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.600883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bd1f-0c0f-40df-96c0-5ccc408b5b07 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.601168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bd1f-0c0f-40df-96c0-5ccc408b5b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.618458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-cb44e4aa-013f-4357-afdc-8d318f33bcdb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.619705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cb44e4aa-013f-4357-afdc-8d318f33bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.621430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6fb6bd1f-0c0f-40df-96c0-5ccc408b5b07 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.622717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6fb6bd1f-0c0f-40df-96c0-5ccc408b5b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.632367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 785/1560] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.633798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6c0f5-3287-4f72-8bd2-d805ec6dafcd None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.634099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6c0f5-3287-4f72-8bd2-d805ec6dafcd None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.634394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6c0f5-3287-4f72-8bd2-d805ec6dafcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.640025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 776/1561] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.640925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bd1f-0c0f-40df-96c0-5ccc408b5b07 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.654273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bd1f-0c0f-40df-96c0-5ccc408b5b07 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.657768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9fc6c0f5-3287-4f72-8bd2-d805ec6dafcd None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.659094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9fc6c0f5-3287-4f72-8bd2-d805ec6dafcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.659223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6212aa-1e24-4e2f-a7c3-855325b49b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.659763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6212aa-1e24-4e2f-a7c3-855325b49b9d admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.660110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6212aa-1e24-4e2f-a7c3-855325b49b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.660490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6212aa-1e24-4e2f-a7c3-855325b49b9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.661234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6212aa-1e24-4e2f-a7c3-855325b49b9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:25.661546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6212aa-1e24-4e2f-a7c3-855325b49b9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.663175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6212aa-1e24-4e2f-a7c3-855325b49b9d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.671178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 786/1562] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.671913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6c0f5-3287-4f72-8bd2-d805ec6dafcd None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.676694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 777/1563] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:25.678417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c28-28c8-430f-a636-146d9d45e389 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.679294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c28-28c8-430f-a636-146d9d45e389 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.679587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca266c28-28c8-430f-a636-146d9d45e389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.685616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6c0f5-3287-4f72-8bd2-d805ec6dafcd None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.688257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.689031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.689316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.689597 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.690441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.692250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.702640 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ca266c28-28c8-430f-a636-146d9d45e389 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.703878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ca266c28-28c8-430f-a636-146d9d45e389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.704028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 787/1564] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:25.704873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.716953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 778/1565] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.718148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c28-28c8-430f-a636-146d9d45e389 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.718871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cfdb48-e479-439a-8f26-73f867bfb91d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.726230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.727130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.727418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.727697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] PATH_INFO: `/v3/projects/1e37dc29ad07404cb1b2e5c68327ede2/users/2a859567189a41e2b7edd6a2e17f87c2/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.732613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca266c28-28c8-430f-a636-146d9d45e389 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.737735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.738407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.738694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.738970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.739737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:25.740047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.741726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.746620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e37dc29ad07404cb1b2e5c68327ede2, user_id=2a859567189a41e2b7edd6a2e17f87c2, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.747724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:51:25.747724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:51:25.747724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:51:25.749741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.755101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 779/1566] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:25.756500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.766259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 788/1567] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:25 2022] PUT /identity/v3/projects/1e37dc29ad07404cb1b2e5c68327ede2/users/2a859567189a41e2b7edd6a2e17f87c2/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:25.767141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.776112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c1673c-6775-4123-a97f-ed508dcde98b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.789959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:25.793281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:25.838367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f2b3-8f36-4b8c-a5ab-428bdc9b1449 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.843945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741aa2d7-a268-4e0e-889e-adc68b7cd4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.844625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa2d7-a268-4e0e-889e-adc68b7cd4cb admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.844877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa2d7-a268-4e0e-889e-adc68b7cd4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.845153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741aa2d7-a268-4e0e-889e-adc68b7cd4cb admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.845875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aa2d7-a268-4e0e-889e-adc68b7cd4cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:25.846185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aa2d7-a268-4e0e-889e-adc68b7cd4cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.847784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741aa2d7-a268-4e0e-889e-adc68b7cd4cb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.851656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.852323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.852645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.852927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.853667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:25.853985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.855644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.863426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 789/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:25.863426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1207f-ec19-4704-a555-de165d9c5b5e None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.863426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1207f-ec19-4704-a555-de165d9c5b5e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.863426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1207f-ec19-4704-a555-de165d9c5b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.875093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 780/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:25.877237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.881853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-82b1207f-ec19-4704-a555-de165d9c5b5e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:25.883073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-82b1207f-ec19-4704-a555-de165d9c5b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:25.887845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dce6ce-af5a-4453-a33f-1ac2abb8dd2e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.891720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 790/1570] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:25.892534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1207f-ec19-4704-a555-de165d9c5b5e None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.893566 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.894215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.894639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.895147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.896194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.899096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.902255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1207f-ec19-4704-a555-de165d9c5b5e None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:25.907651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:25.908574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:25.908865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:25.909151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] PATH_INFO: `/v3/projects/c29a54e53a084a14a10879fc00b2a867/users/fc4e06c1371340a98c2c76457aa74b6a/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:25.925044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c29a54e53a084a14a10879fc00b2a867, user_id=fc4e06c1371340a98c2c76457aa74b6a, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:25.927787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:25.928878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 781/1571] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:25.929756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:25.945747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 791/1572] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:25 2022] PUT /identity/v3/projects/c29a54e53a084a14a10879fc00b2a867/users/fc4e06c1371340a98c2c76457aa74b6a/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:25.950364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.004804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba41d71e-4e44-4468-9311-da23dbde50d0 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.018552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2a1ee-0a47-473a-8589-62bbbd67bddb admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.023678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204bda7c-db17-4e3a-8aea-33a290f85e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.024349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bda7c-db17-4e3a-8aea-33a290f85e93 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.024745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bda7c-db17-4e3a-8aea-33a290f85e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.025029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204bda7c-db17-4e3a-8aea-33a290f85e93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.025731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bda7c-db17-4e3a-8aea-33a290f85e93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.027661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204bda7c-db17-4e3a-8aea-33a290f85e93 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.058961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 792/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.058961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216496-fa65-412f-8c88-7b4ed897c670 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.058961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216496-fa65-412f-8c88-7b4ed897c670 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.058961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63216496-fa65-412f-8c88-7b4ed897c670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.066822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.067538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.067823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.068275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.069066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:26.069385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.071024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.076953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-63216496-fa65-412f-8c88-7b4ed897c670 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:26.078194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-63216496-fa65-412f-8c88-7b4ed897c670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:26.091277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 782/1574] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:26.091277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.097005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db3322f-2d45-4bb5-bf1b-db2f09162693 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.129072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:26.143845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 793/1575] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:26.144762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216496-fa65-412f-8c88-7b4ed897c670 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.155097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63216496-fa65-412f-8c88-7b4ed897c670 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.160040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.160889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.161181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.161466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.162171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.164094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.166444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.167159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.167453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.167820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:26.167963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.168611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.171663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.200070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 794/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.200070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.202276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 783/1577] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/projects => generated 365 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.203155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.266708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db1e3d-ebad-48c0-bd3c-d6264dcc528c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.271569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69512ebb-9854-4823-ae88-6b3548ad375d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.272240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512ebb-9854-4823-ae88-6b3548ad375d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.272579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512ebb-9854-4823-ae88-6b3548ad375d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.272859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69512ebb-9854-4823-ae88-6b3548ad375d admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.273595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69512ebb-9854-4823-ae88-6b3548ad375d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:26.273910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69512ebb-9854-4823-ae88-6b3548ad375d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.275527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69512ebb-9854-4823-ae88-6b3548ad375d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.276522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b45ab-d7b0-4af5-84d2-1a3216abfa71 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.282062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.282737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.283023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.283299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.283997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.286000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.288978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 795/1578] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:26.288978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52ecf2-0b3f-4474-a89c-dec0444af25d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.288978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52ecf2-0b3f-4474-a89c-dec0444af25d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.288978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc52ecf2-0b3f-4474-a89c-dec0444af25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.310851 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-cc52ecf2-0b3f-4474-a89c-dec0444af25d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:26.315209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cc52ecf2-0b3f-4474-a89c-dec0444af25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:26.315363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 784/1579] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/users => generated 291 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.315363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.321084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 796/1580] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:26.322022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52ecf2-0b3f-4474-a89c-dec0444af25d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.326742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be64f54-3570-40b4-907f-4d21e159b48c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.332841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.333291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.333583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.333868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.334115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc52ecf2-0b3f-4474-a89c-dec0444af25d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.334588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.336669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.339005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.339709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.339985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.340264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.340994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.342903 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.359189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 785/1581] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/users => generated 285 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.360105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.361841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:26.376013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 797/1582] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.377268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.426824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18edd6b-3d57-498f-9e0d-f2106b4e084c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.443538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a010a03-326c-4bc4-8af4-7dcd4695c952 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.448147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.448852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.449141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.449422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.450713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.452852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.487127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 798/1583] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.488216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.500065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae244056-eff6-484f-850c-0f9e43124e66 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.505327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.506029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.506324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.506609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.507332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.509738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.538490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 799/1584] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/users => generated 283 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.539558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.551729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5ba276-6983-445b-9fda-852d59366428 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.556993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.557683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.557975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.558258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.558979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.561051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.587170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:26.595688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 800/1585] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/projects => generated 371 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.597059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.614647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:26.626013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.626971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.627256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.627537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.637427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.639501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.649651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 786/1586] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:26.650540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.660353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8e3b3-1eab-46fe-a5bb-62290865bc08 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.661959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7ee4e8-8ab4-43e3-8285-cd2ce2ce58a0 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.669938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.672174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.672749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.673274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.674704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.677251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.695628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 801/1587] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.695628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.706154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7221e7-bbe7-44c1-86ab-be860206f373 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.714073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.714779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.715029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.715322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.718025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.720244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.727499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.728233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.728609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.728893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.736604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 802/1588] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.736604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.746053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.747858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e748ce-fbfa-4c0c-8103-c68fcaf198bb admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.748607 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.754017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.754755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.755055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.755383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.756118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.758323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.760799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 787/1589] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:26.761748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.774050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69952a-f5ba-44e9-ad80-fca957e2f320 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.781069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.781793 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.782149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.782441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.783377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.785329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.786038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 803/1590] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.789460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.807520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b28990-e7af-4289-b2df-5d14c4faae52 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.808690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 788/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.813529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.815558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.816536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.816885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.817402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.818708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.820494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.830659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b0baf0-199c-454a-94ce-285245268448 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.840197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.841390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.842071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.842694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.843687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.844448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 804/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.845932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.846340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.859809 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d9bf4d-c2d1-46a6-a1df-46dfbf9a94b6 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.868362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.869172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.869554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.870043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.870927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.874008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.876891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 789/1593] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:26 2022] POST /identity/v3/users => generated 286 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:26.878168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.889851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b194395b-47ca-4a93-add3-be3ff9c63aec admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.893640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 805/1594] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.893640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.899418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.900678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.900975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.901338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.902653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.904346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.906047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec710007-241b-40dc-b8c5-87d43be002d3 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.911716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.912438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.912737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.913019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.913763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.915368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.920569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 790/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.921802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.932996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 806/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.934113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.936555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f32e53-c767-459e-8239-ce2778360bed admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.941934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.942652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.942943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.943223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.943958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.945591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.955433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fb2c96-0dc1-4038-9bc3-44f1ff7053b1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.959585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 791/1597] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.963047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.967932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:26.967932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:26.967932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:26.967932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:26.968642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:26.969802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:26.986396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 807/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:26.987624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:26.990728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07d45a-74ca-4d54-a7f8-5955a6b7c87f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:26.998681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af4a447-75f3-46ff-99b6-b9d1f07016f3 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.001671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.002929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.003398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.003781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.003967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.004942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.005166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.005267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.005708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] PATH_INFO: `/v3/projects/a559de6cda754d178e31a736b8b03ede/users/6ae0e88f22034d4681f78499bb3e0972/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.008720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.025190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a559de6cda754d178e31a736b8b03ede, user_id=6ae0e88f22034d4681f78499bb3e0972, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.026419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 792/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:26 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:27.026419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:27.031491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.044837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8146e9a4-2818-4815-a336-8ca77f69deb6 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.049779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 808/1600] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:26 2022] PUT /identity/v3/projects/a559de6cda754d178e31a736b8b03ede/users/6ae0e88f22034d4681f78499bb3e0972/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:27.050477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:27.122619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbee36-b2d8-491e-83fe-7118cda495a4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.129363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.130173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.130455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.130741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.131783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.133917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.135647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:27.152549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 809/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:27.153756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:27.154247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.155357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.155648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.155930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] PATH_INFO: `/v3/projects/b60a9115dcc94313b1741fd83baa371b/users/b746a1db14314caea18488bccc72e427/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.165303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e155e4f5-1ef9-48d7-b2e7-be12a4219188 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.171846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.173352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.173352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.173594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] PATH_INFO: `/v3/projects/920197e74a0b449b80d1511e5f5d94ae/users/a9ff9df6775c416f936bc65625aba65d/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.190634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60a9115dcc94313b1741fd83baa371b, user_id=b746a1db14314caea18488bccc72e427, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.195869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.214967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 793/1602] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:27 2022] PUT /identity/v3/projects/b60a9115dcc94313b1741fd83baa371b/users/b746a1db14314caea18488bccc72e427/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:27.215690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:27.228133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=920197e74a0b449b80d1511e5f5d94ae, user_id=a9ff9df6775c416f936bc65625aba65d, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.232841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.252752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:27.263040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 810/1603] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:27 2022] PUT /identity/v3/projects/920197e74a0b449b80d1511e5f5d94ae/users/a9ff9df6775c416f936bc65625aba65d/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:27.264473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:27.329440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705162d1-237c-4328-af7d-73ddce46228e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.361076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d02b57-6a30-48d4-9b85-bb040c8bdd9f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.367967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e590a-88b2-4e25-94e3-f9eee3f269e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.369329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e590a-88b2-4e25-94e3-f9eee3f269e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.369789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e590a-88b2-4e25-94e3-f9eee3f269e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.370400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e590a-88b2-4e25-94e3-f9eee3f269e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.371208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e590a-88b2-4e25-94e3-f9eee3f269e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.374570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984e590a-88b2-4e25-94e3-f9eee3f269e2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.396006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 811/1604] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:27.399626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d98a0-3a98-4e0c-ab67-4e087243fc4d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.400062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d98a0-3a98-4e0c-ab67-4e087243fc4d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.400469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9d98a0-3a98-4e0c-ab67-4e087243fc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.432828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.435284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.435718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.435980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] PATH_INFO: `/v3/projects/3a23ddf55fc642d0a32296a8b50e9025/users/a12ecbae32664fb48ce05dbc70a521d0/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.437645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-df9d98a0-3a98-4e0c-ab67-4e087243fc4d None None] MFA Rules not processed for user `6ae0e88f22034d4681f78499bb3e0972`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:27.438926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-df9d98a0-3a98-4e0c-ab67-4e087243fc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:27.457221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a23ddf55fc642d0a32296a8b50e9025, user_id=a12ecbae32664fb48ce05dbc70a521d0, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.460477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.483914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 794/1605] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:27 2022] PUT /identity/v3/projects/3a23ddf55fc642d0a32296a8b50e9025/users/a12ecbae32664fb48ce05dbc70a521d0/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:27.496642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:27.551262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 812/1606] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:27.551262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc317a-9830-4c71-9754-ed7c15e63f4e None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.551262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc317a-9830-4c71-9754-ed7c15e63f4e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.551262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc317a-9830-4c71-9754-ed7c15e63f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.597940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-60cc317a-9830-4c71-9754-ed7c15e63f4e None None] MFA Rules not processed for user `b746a1db14314caea18488bccc72e427`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:27.599190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-60cc317a-9830-4c71-9754-ed7c15e63f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:27.643833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fdd03f-a85a-4d2a-8510-b125f32b816a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.650361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198b395-f40f-40d5-93ea-50eb2c245236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.651878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b395-f40f-40d5-93ea-50eb2c245236 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.652249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b395-f40f-40d5-93ea-50eb2c245236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.652932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198b395-f40f-40d5-93ea-50eb2c245236 admin admin] PATH_INFO: `/v3/projects/38125a9a5263421ab2a95d71f423bc96/users/07e1ed7064424abdbbd04cdf0b030fd0/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.683919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b395-f40f-40d5-93ea-50eb2c245236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38125a9a5263421ab2a95d71f423bc96, user_id=07e1ed7064424abdbbd04cdf0b030fd0, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.689217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198b395-f40f-40d5-93ea-50eb2c245236 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.696845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:27.733087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 795/1607] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:27 2022] PUT /identity/v3/projects/38125a9a5263421ab2a95d71f423bc96/users/07e1ed7064424abdbbd04cdf0b030fd0/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:27.738566 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b463-05e7-4d64-9949-4196b8537a58 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.739536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b463-05e7-4d64-9949-4196b8537a58 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.739903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370b463-05e7-4d64-9949-4196b8537a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.751380 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 813/1608] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:27.752656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc317a-9830-4c71-9754-ed7c15e63f4e None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:27.767272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc317a-9830-4c71-9754-ed7c15e63f4e None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:27.808729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3370b463-05e7-4d64-9949-4196b8537a58 None None] MFA Rules not processed for user `a9ff9df6775c416f936bc65625aba65d`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:27.813439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3370b463-05e7-4d64-9949-4196b8537a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:27.832141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:27.901106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:27.902925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.903073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.903891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] PATH_INFO: `/v3/projects/808d6a81906842df87aed074f50318fa/users/620ec5025a7640d9ba0cd4361251cbbf/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.941265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 796/1609] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:27.941684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] RBAC: Authorizing `identity:create_grant(project_id=808d6a81906842df87aed074f50318fa, user_id=620ec5025a7640d9ba0cd4361251cbbf, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:27.945276 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:27.947026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361f537-bc9d-402a-9742-506ecc304945 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:27.947612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361f537-bc9d-402a-9742-506ecc304945 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:27.948089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e361f537-bc9d-402a-9742-506ecc304945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:27.974751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 814/1610] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:27 2022] PUT /identity/v3/projects/808d6a81906842df87aed074f50318fa/users/620ec5025a7640d9ba0cd4361251cbbf/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:27.975930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.022417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e361f537-bc9d-402a-9742-506ecc304945 None None] MFA Rules not processed for user `a12ecbae32664fb48ce05dbc70a521d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:28.023960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e361f537-bc9d-402a-9742-506ecc304945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:28.140041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1cd88-5632-4ff6-a9f2-4f97c139e26b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.149796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a139ea0-7387-44e9-87cd-a5d131280fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.150857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139ea0-7387-44e9-87cd-a5d131280fca admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.151200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139ea0-7387-44e9-87cd-a5d131280fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.151493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a139ea0-7387-44e9-87cd-a5d131280fca admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.152357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a139ea0-7387-44e9-87cd-a5d131280fca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.155783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a139ea0-7387-44e9-87cd-a5d131280fca admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.196266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 815/1611] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:27 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:28.197782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406853ee-ff4e-437b-a107-9cf823397450 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.198132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406853ee-ff4e-437b-a107-9cf823397450 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.198430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406853ee-ff4e-437b-a107-9cf823397450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.207441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 797/1612] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:27 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:28.207441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361f537-bc9d-402a-9742-506ecc304945 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.221312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-406853ee-ff4e-437b-a107-9cf823397450 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:28.224195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-406853ee-ff4e-437b-a107-9cf823397450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:28.235772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e361f537-bc9d-402a-9742-506ecc304945 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.321046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:28.360541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 816/1613] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:28.360541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406853ee-ff4e-437b-a107-9cf823397450 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.384007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406853ee-ff4e-437b-a107-9cf823397450 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.393193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb175dd-eeb0-4d7a-8269-3645bab2075c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.393193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb175dd-eeb0-4d7a-8269-3645bab2075c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.393193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb175dd-eeb0-4d7a-8269-3645bab2075c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.393193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb175dd-eeb0-4d7a-8269-3645bab2075c admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.394664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb175dd-eeb0-4d7a-8269-3645bab2075c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.397230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb175dd-eeb0-4d7a-8269-3645bab2075c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.397727 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.398613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.399173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.399704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.400644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.403218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.437180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 798/1614] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/projects => generated 373 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:28.438963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f29da8-4de4-4ed2-9657-2123d1f882b0 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.439363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f29da8-4de4-4ed2-9657-2123d1f882b0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.439830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f29da8-4de4-4ed2-9657-2123d1f882b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.447995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 817/1615] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/projects => generated 363 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:28.449136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.479312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-49f29da8-4de4-4ed2-9657-2123d1f882b0 None None] MFA Rules not processed for user `620ec5025a7640d9ba0cd4361251cbbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:28.481055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-49f29da8-4de4-4ed2-9657-2123d1f882b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:28.509103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:28.621432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd0671c-11df-407f-a20c-b52138f95fcb admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.631053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 799/1616] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:28.632420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f29da8-4de4-4ed2-9657-2123d1f882b0 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.637302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.638153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.638447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.638730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.639451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.641684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.651050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f29da8-4de4-4ed2-9657-2123d1f882b0 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.663068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.663819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.664553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.664697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.669951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.669951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.688525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 818/1617] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:28.689412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.717337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 800/1618] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/projects => generated 363 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:28.718433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.839713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662f646-e011-4c67-888b-a655cf173476 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.839976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4ec950-31b2-4c99-95b8-0606c38ea4d6 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.849815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.851413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.851827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.854285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.855307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.859253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.912558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 801/1619] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:28.913214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:28.930270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c3bff5-841d-4d8d-8e73-453f4a3cbb35 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:28.936723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.937424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.937719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.939248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.940105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.942406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.966836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ba06c7-414e-4b0b-84cc-8fc9093a3c80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:28.968490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba06c7-414e-4b0b-84cc-8fc9093a3c80 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:28.968856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba06c7-414e-4b0b-84cc-8fc9093a3c80 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:28.969327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ba06c7-414e-4b0b-84cc-8fc9093a3c80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:28.991438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba06c7-414e-4b0b-84cc-8fc9093a3c80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:28.993714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ba06c7-414e-4b0b-84cc-8fc9093a3c80 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:28.995162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 802/1620] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:28 2022] POST /identity/v3/users => generated 288 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:28.998530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.011233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 819/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:29.013679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55d62-a4a5-4f9a-95be-ff263ff173eb None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.014126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55d62-a4a5-4f9a-95be-ff263ff173eb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.015225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f55d62-a4a5-4f9a-95be-ff263ff173eb None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.018898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 820/1622] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 30 12:51:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:51:29.021389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55d62-a4a5-4f9a-95be-ff263ff173eb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.023343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e3687d-ced2-46cd-b9a5-4f3a89319485 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.041692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.042481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.044825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.045698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.048121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.051474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f55d62-a4a5-4f9a-95be-ff263ff173eb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.052738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.060443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.061294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.061589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.061874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.063790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.066384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.080234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 803/1623] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:29.084539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.100969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 821/1624] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:29 2022] POST /identity/v3/users => generated 288 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:29.102082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.108881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446ee2f-abc8-40eb-b284-4fcd18f13b97 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.111454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:29.116342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6130efaf-505c-4bdc-a465-cb1e3fb1f52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.117391 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130efaf-505c-4bdc-a465-cb1e3fb1f52e admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.117883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130efaf-505c-4bdc-a465-cb1e3fb1f52e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.118377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6130efaf-505c-4bdc-a465-cb1e3fb1f52e admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.119571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ad755b-36a3-41f2-80ed-61fe9eac44c0 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.119814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130efaf-505c-4bdc-a465-cb1e3fb1f52e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.123993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6130efaf-505c-4bdc-a465-cb1e3fb1f52e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.130767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.132013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.132418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.133472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.134735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.136719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.141439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 804/1625] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:29.143310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b442-3e02-4dcb-96d5-9cbb765bdcfd None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.143836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b442-3e02-4dcb-96d5-9cbb765bdcfd None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.145050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b442-3e02-4dcb-96d5-9cbb765bdcfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.165534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 822/1626] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:29.168122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.198628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-91e2b442-3e02-4dcb-96d5-9cbb765bdcfd None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:29.201733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85c889-faca-495f-9402-507ed9b77e74 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.204652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-91e2b442-3e02-4dcb-96d5-9cbb765bdcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:29.212419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.214874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.217833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.218278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] PATH_INFO: `/v3/projects/fa1ffda55a794cb59d95949197248b39/users/cf7331bb89024a0aad23b393bbd77bce/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.247737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1ffda55a794cb59d95949197248b39, user_id=cf7331bb89024a0aad23b393bbd77bce, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.251183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.286915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 823/1627] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:29 2022] PUT /identity/v3/projects/fa1ffda55a794cb59d95949197248b39/users/cf7331bb89024a0aad23b393bbd77bce/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:29.290341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.339417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:29.393596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 805/1628] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 30 12:51:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:29.394231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b442-3e02-4dcb-96d5-9cbb765bdcfd None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.426978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b442-3e02-4dcb-96d5-9cbb765bdcfd None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.477301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb86b7-857e-41e5-9941-0485eb80cf11 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.487907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.489096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.489875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.489875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.490555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.492492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.519054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 824/1629] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:29.519992 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.542685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eca4989-a5c4-4f08-9f98-1df10ddb3cef admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.549500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.550460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.551286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.552110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] PATH_INFO: `/v3/projects/c17b70c2d29441fdb340232aefc8cefb/users/d0bd6b27d9804007a25ab77c6979bee2/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.557050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.558203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.558720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.559187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] PATH_INFO: `/v3/projects/d2bf1d2729504ac2b6df7f13c4706b93/users/b691de8ad4834156a342424b17458e8f/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.577674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17b70c2d29441fdb340232aefc8cefb, user_id=d0bd6b27d9804007a25ab77c6979bee2, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.581258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.713972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 806/1630] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:29 2022] PUT /identity/v3/projects/c17b70c2d29441fdb340232aefc8cefb/users/d0bd6b27d9804007a25ab77c6979bee2/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:29.713972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.716762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf1d2729504ac2b6df7f13c4706b93, user_id=b691de8ad4834156a342424b17458e8f, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.716762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:29.727132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 825/1631] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:29 2022] PUT /identity/v3/projects/d2bf1d2729504ac2b6df7f13c4706b93/users/b691de8ad4834156a342424b17458e8f/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:29.730271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:29.822693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d13448-6e94-42fb-b893-6e178e426a0c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.955942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ceca15f-bce0-49f7-9122-3cc4af403745 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:29.966164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.967651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.968693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.968947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:29.969908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:29.970316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:29.970699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.976360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:29.978974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:29.982509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.009745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 807/1632] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:29 2022] GET /identity/v3/roles => generated 1420 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:30.011051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.022328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:30.035343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19989c-ca1a-414d-8b82-b334a0a1b577 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.046638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.047879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.048262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.049140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] PATH_INFO: `/v3/projects/d90a020be2274d5195715a044898c0ad/users/8a92bb74dc1943edac964a3fc810291b/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.060829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:30.071065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90a020be2274d5195715a044898c0ad, user_id=8a92bb74dc1943edac964a3fc810291b, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.075829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.108099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 808/1633] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:30 2022] PUT /identity/v3/projects/d90a020be2274d5195715a044898c0ad/users/8a92bb74dc1943edac964a3fc810291b/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:30.109947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.119378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.123510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.151114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 826/1634] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:30.154139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.194630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20db59d7-b230-4138-9a2e-83ade3e92fac service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.366493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1547cfa3-375a-430c-add9-60e2f28c5a83 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.377062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.378061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.378348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.378641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.379909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.381735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.398134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 809/1635] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:30.399091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.414182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733fb07d-60df-412d-b58f-52cc468e68ed admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.429009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.429275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.430058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.430356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.430642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.431204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.431503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.431774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.431891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] PATH_INFO: `/v3/projects/fa1ffda55a794cb59d95949197248b39/users/cf7331bb89024a0aad23b393bbd77bce/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.436735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.440684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa1ffda55a794cb59d95949197248b39, user_id=cf7331bb89024a0aad23b393bbd77bce, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.448494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.463689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 827/1636] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:30.464950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.481036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13ea05a-1b34-4cae-82a4-b40878d082b7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.485938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 810/1637] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:30 2022] PUT /identity/v3/projects/fa1ffda55a794cb59d95949197248b39/users/cf7331bb89024a0aad23b393bbd77bce/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:30.487015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.617534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.618841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.619443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.619914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.625525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.632681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.662507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 828/1638] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:30 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:30.662507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.674884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e2b42f-0d43-46c1-baaf-54debf454224 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.688687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981cb8a1-01ab-4025-82d7-d0673dc63bc7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.689850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6de48bd-a56a-40c7-83a5-dd95aa5417aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.691724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de48bd-a56a-40c7-83a5-dd95aa5417aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.692081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de48bd-a56a-40c7-83a5-dd95aa5417aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.692548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6de48bd-a56a-40c7-83a5-dd95aa5417aa admin admin] PATH_INFO: `/v3/projects/c17b70c2d29441fdb340232aefc8cefb/users/d0bd6b27d9804007a25ab77c6979bee2/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.695413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.696658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.697407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.698003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] PATH_INFO: `/v3/projects/d2bf1d2729504ac2b6df7f13c4706b93/users/b691de8ad4834156a342424b17458e8f/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.700603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de48bd-a56a-40c7-83a5-dd95aa5417aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c17b70c2d29441fdb340232aefc8cefb, user_id=d0bd6b27d9804007a25ab77c6979bee2, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.701586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2bf1d2729504ac2b6df7f13c4706b93, user_id=b691de8ad4834156a342424b17458e8f, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.704429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6de48bd-a56a-40c7-83a5-dd95aa5417aa admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.704827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.730550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 811/1639] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:30 2022] PUT /identity/v3/projects/c17b70c2d29441fdb340232aefc8cefb/users/d0bd6b27d9804007a25ab77c6979bee2/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:30.730550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a290ac8-e532-41f9-b567-d50a2f5eb564 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.730550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a290ac8-e532-41f9-b567-d50a2f5eb564 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.730550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a290ac8-e532-41f9-b567-d50a2f5eb564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.731097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 829/1640] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:30 2022] PUT /identity/v3/projects/d2bf1d2729504ac2b6df7f13c4706b93/users/b691de8ad4834156a342424b17458e8f/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:30.731097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:30.771879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-8a290ac8-e532-41f9-b567-d50a2f5eb564 None None] MFA Rules not processed for user `cf7331bb89024a0aad23b393bbd77bce`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:30.773237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8a290ac8-e532-41f9-b567-d50a2f5eb564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:30.864582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:30.912225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 812/1641] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:30.919887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120471-12f1-4726-859a-365cafaae4a6 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.919887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120471-12f1-4726-859a-365cafaae4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.919887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120471-12f1-4726-859a-365cafaae4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.944596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:30.952435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d3859-2c17-4735-a24d-e23cee297bcf admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:30.959109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-85120471-12f1-4726-859a-365cafaae4a6 None None] MFA Rules not processed for user `d0bd6b27d9804007a25ab77c6979bee2`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:30.960778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-85120471-12f1-4726-859a-365cafaae4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:30.961564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00f49-d799-4aaa-bfcc-a45f87519ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:30.963379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00f49-d799-4aaa-bfcc-a45f87519ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.963991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00f49-d799-4aaa-bfcc-a45f87519ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.964856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00f49-d799-4aaa-bfcc-a45f87519ad8 admin admin] PATH_INFO: `/v3/projects/d90a020be2274d5195715a044898c0ad/users/8a92bb74dc1943edac964a3fc810291b/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:30.967667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00f49-d799-4aaa-bfcc-a45f87519ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d90a020be2274d5195715a044898c0ad, user_id=8a92bb74dc1943edac964a3fc810291b, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:30.970940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00f49-d799-4aaa-bfcc-a45f87519ad8 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:30.988048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 830/1642] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:30 2022] PUT /identity/v3/projects/d90a020be2274d5195715a044898c0ad/users/8a92bb74dc1943edac964a3fc810291b/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:30.990684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc083f3-04f8-4317-970b-921645fbf5f2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:30.991243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc083f3-04f8-4317-970b-921645fbf5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:30.991790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc083f3-04f8-4317-970b-921645fbf5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.049002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 813/1643] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:31.050547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85120471-12f1-4726-859a-365cafaae4a6 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:31.061996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3dc083f3-04f8-4317-970b-921645fbf5f2 None None] MFA Rules not processed for user `b691de8ad4834156a342424b17458e8f`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:31.064957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3dc083f3-04f8-4317-970b-921645fbf5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:31.125588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85120471-12f1-4726-859a-365cafaae4a6 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:31.245796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:31.246693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:31.247992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:31.247992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.252920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 831/1644] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:30 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:31.255965 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847b59a-e2cb-480c-9773-e841ae82ee03 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:31.258768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847b59a-e2cb-480c-9773-e841ae82ee03 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:31.259820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847b59a-e2cb-480c-9773-e841ae82ee03 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.264170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 832/1645] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 30 12:51:31 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:51:31.267978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb6e4b-8043-4766-acf9-9612910c6ebf None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:31.269404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb6e4b-8043-4766-acf9-9612910c6ebf None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:31.270295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb6e4b-8043-4766-acf9-9612910c6ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.330104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:31.348313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5fdb6e4b-8043-4766-acf9-9612910c6ebf None None] MFA Rules not processed for user `8a92bb74dc1943edac964a3fc810291b`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:31.350573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5fdb6e4b-8043-4766-acf9-9612910c6ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:31.394202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:31.398671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:31.440062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 814/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:31.441155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:31.461713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955dbc40-6177-44b4-b80c-a3ae48ccedc4 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:31.471471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:31.472585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:31.472778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:31.473349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.583196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 833/1647] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:31.584253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408c3d6-df23-4ed9-9691-417b418c94fa None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:31.584658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408c3d6-df23-4ed9-9691-417b418c94fa None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:31.584993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0408c3d6-df23-4ed9-9691-417b418c94fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.621779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-0408c3d6-df23-4ed9-9691-417b418c94fa None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:31.625764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-0408c3d6-df23-4ed9-9691-417b418c94fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:31.643188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:31.644921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:31.673753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 815/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:31.674717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:31.708007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ed18c9-2474-4393-bb22-a0bae6332abb service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:31.719497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:31.720173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:31.720485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:31.720766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.745666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:31.747796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:31.765540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 816/1649] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:31.892772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:31.932040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:31.938715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 834/1650] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:51:31 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:31.941350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125b3a9c-4d65-4280-9afb-3befb9fb04c1 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:31.951615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:31.952290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:31.953955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:31.954378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:31.983007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:31.989110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:32.042137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 817/1651] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:31 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:32.284652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408c3d6-df23-4ed9-9691-417b418c94fa None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:32.304839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:32.307078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0408c3d6-df23-4ed9-9691-417b418c94fa None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:32.322197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beb422-a5f9-4a4a-8408-968cba48ef66 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:32.333417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:32.334132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:32.334420 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:32.334698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:32.340421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:32.342191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:32.342191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:32.342191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:32.358921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:32.361460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:32.397561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 835/1652] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:32 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:32.497709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:32.499701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:32.537373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 818/1653] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:32 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:32.896304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:32.913134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871ce713-dc89-4231-b46a-055fc3e5af8c service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:32.930574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fe62a-f15f-41a0-bafa-5f81956823e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:32.932357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe62a-f15f-41a0-bafa-5f81956823e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:32.932976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe62a-f15f-41a0-bafa-5f81956823e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:32.933577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fe62a-f15f-41a0-bafa-5f81956823e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:33.143136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe62a-f15f-41a0-bafa-5f81956823e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:33.144845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fe62a-f15f-41a0-bafa-5f81956823e1 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:33.157088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 836/1654] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:32 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:33.407512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:33.422013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a199a2a8-dae7-4f62-9a65-4e088f2b83bb service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:33.446212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f1dcae-de29-4de3-8d42-b42dd7ead9cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:33.446904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dcae-de29-4de3-8d42-b42dd7ead9cd service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:33.460537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dcae-de29-4de3-8d42-b42dd7ead9cd service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:33.461108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f1dcae-de29-4de3-8d42-b42dd7ead9cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:33.635154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:33.731330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1dcae-de29-4de3-8d42-b42dd7ead9cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:33.732966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f1dcae-de29-4de3-8d42-b42dd7ead9cd service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:33.786061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 819/1655] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:33 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:34.427587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a19d-ed8e-421b-a0bc-8ec751e7cd38 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:34.428114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a19d-ed8e-421b-a0bc-8ec751e7cd38 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:34.428616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1956a19d-ed8e-421b-a0bc-8ec751e7cd38 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:34.430644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 837/1656] 10.222.0.20 () {54 vars in 961 bytes} [Thu Jun 30 12:51:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:51:34.448549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5f7a8-5f40-446c-9d70-52dca2e1c954 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:34.449166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5f7a8-5f40-446c-9d70-52dca2e1c954 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:34.449550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf5f7a8-5f40-446c-9d70-52dca2e1c954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:34.523288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-4cf5f7a8-5f40-446c-9d70-52dca2e1c954 None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:34.535747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4cf5f7a8-5f40-446c-9d70-52dca2e1c954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:34.573662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 820/1657] 10.222.0.20 () {58 vars in 1058 bytes} [Thu Jun 30 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:34.573980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9edd-f20f-484c-8760-7be50c8e4445 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:34.574538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9edd-f20f-484c-8760-7be50c8e4445 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:34.576200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811d9edd-f20f-484c-8760-7be50c8e4445 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:34.580145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 838/1658] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 30 12:51:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:51:34.591571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044917c-413a-4638-ae9b-f55222d4fd96 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:34.591571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044917c-413a-4638-ae9b-f55222d4fd96 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:34.591571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044917c-413a-4638-ae9b-f55222d4fd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:34.634708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b044917c-413a-4638-ae9b-f55222d4fd96 None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:34.641334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b044917c-413a-4638-ae9b-f55222d4fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:34.671902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 821/1659] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:51:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:34.680643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9edd-f20f-484c-8760-7be50c8e4445 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:34.742393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044917c-413a-4638-ae9b-f55222d4fd96 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:34.950322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811d9edd-f20f-484c-8760-7be50c8e4445 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:34.969382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:34.970471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:34.971571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:34.973558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] PATH_INFO: `/v3/users/a9ff9df6775c416f936bc65625aba65d` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:34.978381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9ff9df6775c416f936bc65625aba65d)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:34.980040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044917c-413a-4638-ae9b-f55222d4fd96 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:34.980567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: WARNING py.warnings [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:51:34.980567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: warnings.warn(msg) Jun 30 12:51:34.980567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: Jun 30 12:51:34.987601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:34.995969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:35.000913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:35.001715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:35.002558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] PATH_INFO: `/v3/users/6ae0e88f22034d4681f78499bb3e0972` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:35.009352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae0e88f22034d4681f78499bb3e0972)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:35.015249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:35.160868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9ff9df6775c416f936bc65625aba65d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.184334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9ff9df6775c416f936bc65625aba65d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.195764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae0e88f22034d4681f78499bb3e0972'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.213214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae0e88f22034d4681f78499bb3e0972'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.214501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae0e88f22034d4681f78499bb3e0972'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.216300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae0e88f22034d4681f78499bb3e0972'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.240930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9ff9df6775c416f936bc65625aba65d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.244883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9ff9df6775c416f936bc65625aba65d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.250286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae0e88f22034d4681f78499bb3e0972'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.280366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49b8f65a-0e35-4503-a952-90391769fd81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9ff9df6775c416f936bc65625aba65d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:35.285277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 822/1660] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:34 2022] DELETE /identity/v3/users/6ae0e88f22034d4681f78499bb3e0972 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:51:35.286261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:35.286386 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:35.289343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:35.303836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 839/1661] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:34 2022] DELETE /identity/v3/users/a9ff9df6775c416f936bc65625aba65d => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:35.307103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da8a7-6cb7-4b1d-980f-fa6012838e3a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:35.307403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da8a7-6cb7-4b1d-980f-fa6012838e3a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:35.307690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669da8a7-6cb7-4b1d-980f-fa6012838e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:35.330619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-669da8a7-6cb7-4b1d-980f-fa6012838e3a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:35.332211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-669da8a7-6cb7-4b1d-980f-fa6012838e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:35.428808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:35.459210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd50f38-db43-442f-bf7e-51bc9cea74f7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:35.527499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 840/1662] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:35.530169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:35.531042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:35.531465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:35.566747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:35.569850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:35.607214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:35.610490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:35.612687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:35.613532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:35.623044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:35.656816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 841/1663] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:35.657930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:35.662142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:35.896834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336d030-e8c9-42a5-b5bb-925bd67b109a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:35.915922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:35.917195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:35.917768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:35.918202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:35.930720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:35.935261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:35.954983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:35.958181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:35.963998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 823/1664] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:35 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 678 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:35.968982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:35.974138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:36.005545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc6357-ffcd-4246-898a-2b36d876f35b service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:36.023122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9179d269-1462-402f-b1ee-d1ae74c5b39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:36.024048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d269-1462-402f-b1ee-d1ae74c5b39a service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:36.024377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d269-1462-402f-b1ee-d1ae74c5b39a service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:36.024909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9179d269-1462-402f-b1ee-d1ae74c5b39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:36.025855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 842/1665] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:36.084007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d269-1462-402f-b1ee-d1ae74c5b39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:36.085514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9179d269-1462-402f-b1ee-d1ae74c5b39a service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:36.125281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 824/1666] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:36.256475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:36.258053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:36.295357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9577ae24-d44b-4239-a817-6a1eb9eb4ae8 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:36.315951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:36.321177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:36.321631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:36.321881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] PATH_INFO: `/v3/users/a12ecbae32664fb48ce05dbc70a521d0` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:36.328034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a12ecbae32664fb48ce05dbc70a521d0)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:36.330071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:36.482410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a12ecbae32664fb48ce05dbc70a521d0'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:36.491811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a12ecbae32664fb48ce05dbc70a521d0'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:36.530660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a12ecbae32664fb48ce05dbc70a521d0'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:36.535136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a12ecbae32664fb48ce05dbc70a521d0'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:36.557187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a12ecbae32664fb48ce05dbc70a521d0'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:36.577765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 843/1667] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:36 2022] DELETE /identity/v3/users/a12ecbae32664fb48ce05dbc70a521d0 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:36.583375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:36.583961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:36.584038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:36.649878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:36.654336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:36.713940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:36.716951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:36.738244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:36.850433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 825/1668] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:36.908882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8391937-74a8-46f7-8ac8-82a903d0587c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:36.921576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:36.922422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:36.922749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:36.924204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] PATH_INFO: `/v3/users/b746a1db14314caea18488bccc72e427` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:36.928685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b746a1db14314caea18488bccc72e427)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:36.931567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:36.979628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:36.982899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:37.024583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b746a1db14314caea18488bccc72e427'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:37.065971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b746a1db14314caea18488bccc72e427'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:37.092228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:37.111109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b746a1db14314caea18488bccc72e427'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:37.114594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b746a1db14314caea18488bccc72e427'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:37.130727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28facead-263c-4539-bac1-631be55eb9a7 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:37.135570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:37.136233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:37.136552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:37.137206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:37.140704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:37.141540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c8a1686f-8852-4c2b-a0cb-36f339a96b2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b746a1db14314caea18488bccc72e427'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:37.160004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:37.161252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:37.163268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 844/1669] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:36 2022] DELETE /identity/v3/users/b746a1db14314caea18488bccc72e427 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:37.167575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:37.167950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:37.168303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:37.173281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 826/1670] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:37.199854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:37.201694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:37.396793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 845/1671] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:51:37.450808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:37.452602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:37.479973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f0c90-4f3e-4de5-8d9b-d6ef1b950d63 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:37.598626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:37.600325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:37.602395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:37.603087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:37.626709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:37.628597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:37.643132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 827/1672] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:37.927121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:37.927609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:37.968842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c7b3e-9a36-40f2-ad4a-0dd3ae5aa628 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:37.986035 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:37.993690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:37.997292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:37.998908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] PATH_INFO: `/v3/users/620ec5025a7640d9ba0cd4361251cbbf` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:38.000778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620ec5025a7640d9ba0cd4361251cbbf)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:38.005634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:38.071196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:38.073425 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:38.099329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04290d08-7d7a-4296-ab71-29a770bffe06 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:38.118004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:38.119007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:38.119361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:38.119706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] PATH_INFO: `/v3/projects/920197e74a0b449b80d1511e5f5d94ae` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:38.133703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920197e74a0b449b80d1511e5f5d94ae)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:38.135855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:38.138547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: WARNING py.warnings [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 30 12:51:38.138547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: warnings.warn(msg) Jun 30 12:51:38.138547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: Jun 30 12:51:38.140854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:38.201928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620ec5025a7640d9ba0cd4361251cbbf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.218410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620ec5025a7640d9ba0cd4361251cbbf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.251671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620ec5025a7640d9ba0cd4361251cbbf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.258063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620ec5025a7640d9ba0cd4361251cbbf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.288338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620ec5025a7640d9ba0cd4361251cbbf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.312787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 846/1673] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:37 2022] DELETE /identity/v3/users/620ec5025a7640d9ba0cd4361251cbbf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:38.314567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:38.319841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:38.323307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920197e74a0b449b80d1511e5f5d94ae', 'request_id': 'req-8a1a64de-ef9c-46a7-950f-2e2347856934'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.345471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920197e74a0b449b80d1511e5f5d94ae', 'request_id': 'req-8a1a64de-ef9c-46a7-950f-2e2347856934'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.367418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920197e74a0b449b80d1511e5f5d94ae', 'request_id': 'req-8a1a64de-ef9c-46a7-950f-2e2347856934'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.399086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] The token cache is being invalidate because project 920197e74a0b449b80d1511e5f5d94ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:38.399526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.401665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8a1a64de-ef9c-46a7-950f-2e2347856934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.407856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 828/1674] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:38 2022] DELETE /identity/v3/projects/920197e74a0b449b80d1511e5f5d94ae => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:38.410142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:38.410721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:38.411521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:38.471321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:38.477290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:38.482675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed250385-2350-4903-82cb-13c52c157018 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:38.493699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:38.494590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:38.494875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:38.495152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] PATH_INFO: `/v3/projects/3a23ddf55fc642d0a32296a8b50e9025` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:38.498962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a23ddf55fc642d0a32296a8b50e9025)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:38.501100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:38.521728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 829/1675] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:38.530787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:38.565713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:38.610419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e509f85d-ed49-4e2a-8fdb-31a62b1abb89 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:38.650212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a23ddf55fc642d0a32296a8b50e9025', 'request_id': 'req-4f9db52c-e0d4-41ad-a6de-722d725bc77e'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.665344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a23ddf55fc642d0a32296a8b50e9025', 'request_id': 'req-4f9db52c-e0d4-41ad-a6de-722d725bc77e'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.677027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a23ddf55fc642d0a32296a8b50e9025', 'request_id': 'req-4f9db52c-e0d4-41ad-a6de-722d725bc77e'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.706447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] The token cache is being invalidate because project 3a23ddf55fc642d0a32296a8b50e9025 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:38.706784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.708644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.714800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 847/1676] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:38 2022] DELETE /identity/v3/projects/3a23ddf55fc642d0a32296a8b50e9025 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:38.718048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:38.730323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:38.754252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:38.787291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:38.796107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:38.796107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:38.796107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] PATH_INFO: `/v3/projects/a559de6cda754d178e31a736b8b03ede` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:38.797868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a559de6cda754d178e31a736b8b03ede)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:38.807385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:38.827274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:38.915121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9db52c-e0d4-41ad-a6de-722d725bc77e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:38.969540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a559de6cda754d178e31a736b8b03ede', 'request_id': 'req-6481b9fd-daf6-470b-85ea-0c558c5a2a72'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:38.983961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a559de6cda754d178e31a736b8b03ede', 'request_id': 'req-6481b9fd-daf6-470b-85ea-0c558c5a2a72'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.006950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a559de6cda754d178e31a736b8b03ede', 'request_id': 'req-6481b9fd-daf6-470b-85ea-0c558c5a2a72'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.043299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] The token cache is being invalidate because project a559de6cda754d178e31a736b8b03ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:39.043641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.044377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.050865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 830/1677] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:38 2022] DELETE /identity/v3/projects/a559de6cda754d178e31a736b8b03ede => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:39.052048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:39.055926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:39.073015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:39.074059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:39.074439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:39.075606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] PATH_INFO: `/v3/users/b691de8ad4834156a342424b17458e8f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:39.080192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b691de8ad4834156a342424b17458e8f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:39.093050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:39.264415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b691de8ad4834156a342424b17458e8f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.280502 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b691de8ad4834156a342424b17458e8f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.302738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b691de8ad4834156a342424b17458e8f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.303797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6481b9fd-daf6-470b-85ea-0c558c5a2a72 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:39.306937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b691de8ad4834156a342424b17458e8f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.311349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:39.311483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:39.311710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:39.311995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:39.318762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:39.325988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b691de8ad4834156a342424b17458e8f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.338738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 848/1678] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:38 2022] DELETE /identity/v3/users/b691de8ad4834156a342424b17458e8f => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:39.340211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:39.343683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:39.353065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:39.357801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:39.379604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 831/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:39.380871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:39.382293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:39.411408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b13f9-5469-4760-80fe-8dbc953083d9 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:39.492714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:39.514105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953fa511-4325-4da4-b39a-587e63661d3e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:39.529042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:39.531354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:39.531960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:39.532464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] PATH_INFO: `/v3/users/8a92bb74dc1943edac964a3fc810291b` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:39.539217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a92bb74dc1943edac964a3fc810291b)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:39.545885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:39.578803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:39.580972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:39.581728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:39.581728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] PATH_INFO: `/v3/users/cf7331bb89024a0aad23b393bbd77bce` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:39.587339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf7331bb89024a0aad23b393bbd77bce)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:39.587339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:39.672646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:39.675802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a92bb74dc1943edac964a3fc810291b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.698430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a92bb74dc1943edac964a3fc810291b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.724564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf7331bb89024a0aad23b393bbd77bce'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.735305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a92bb74dc1943edac964a3fc810291b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.736292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a92bb74dc1943edac964a3fc810291b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.743874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf7331bb89024a0aad23b393bbd77bce'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.744503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf7331bb89024a0aad23b393bbd77bce'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.745405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf7331bb89024a0aad23b393bbd77bce'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.754482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b55d4904-a5a7-4f50-acb6-961152bc1c11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a92bb74dc1943edac964a3fc810291b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.774760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 849/1680] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:39 2022] DELETE /identity/v3/users/8a92bb74dc1943edac964a3fc810291b => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:39.776214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf7331bb89024a0aad23b393bbd77bce'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:39.779947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:39.788130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:39.788591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:39.810182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 832/1681] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:39 2022] DELETE /identity/v3/users/cf7331bb89024a0aad23b393bbd77bce => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:39.841700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] MFA Rules not processed for user `2a859567189a41e2b7edd6a2e17f87c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:39.845641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:39.863878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:39.865463 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:40.006443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d53c85-ec51-4712-9b91-ba1d74dd6c19 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:40.013305 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:40.014321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:40.014700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:40.014919 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 850/1682] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:39 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:40.015035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] PATH_INFO: `/v3/projects/d2bf1d2729504ac2b6df7f13c4706b93` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:40.016206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2bf1d2729504ac2b6df7f13c4706b93)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:40.018560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:40.032948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:40.035404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:40.107196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2bf1d2729504ac2b6df7f13c4706b93', 'request_id': 'req-ce8601ad-9c3c-4195-bbf6-327e6021290f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:40.116969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2bf1d2729504ac2b6df7f13c4706b93', 'request_id': 'req-ce8601ad-9c3c-4195-bbf6-327e6021290f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:40.133844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2bf1d2729504ac2b6df7f13c4706b93', 'request_id': 'req-ce8601ad-9c3c-4195-bbf6-327e6021290f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:40.165359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] The token cache is being invalidate because project d2bf1d2729504ac2b6df7f13c4706b93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:40.165662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:40.166416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ce8601ad-9c3c-4195-bbf6-327e6021290f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:40.173371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 833/1683] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:39 2022] DELETE /identity/v3/projects/d2bf1d2729504ac2b6df7f13c4706b93 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:40.174988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352383b-ffdc-4e3a-bff4-b2614fed9b17 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:40.175280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352383b-ffdc-4e3a-bff4-b2614fed9b17 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:40.175660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3352383b-ffdc-4e3a-bff4-b2614fed9b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:40.214082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3352383b-ffdc-4e3a-bff4-b2614fed9b17 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:40.215930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3352383b-ffdc-4e3a-bff4-b2614fed9b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:40.257038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:40.258324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:40.275640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ec8e8-6c30-42b5-a8a6-278f79506c5f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:40.334682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 834/1684] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:40.336255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0b7e-d0eb-4936-b58b-4732746724f3 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:40.336578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0b7e-d0eb-4936-b58b-4732746724f3 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:40.341092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0d0b7e-d0eb-4936-b58b-4732746724f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:40.383455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9f0d0b7e-d0eb-4936-b58b-4732746724f3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:40.386267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9f0d0b7e-d0eb-4936-b58b-4732746724f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:40.424805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 835/1685] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:40.427307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0b7e-d0eb-4936-b58b-4732746724f3 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:40.445022 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0d0b7e-d0eb-4936-b58b-4732746724f3 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:40.455043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:40.455973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:40.456266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:40.456601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:40.458818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:40.459834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:40.459834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:40.460020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:40.460776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:40.461087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:40.463677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:40.469308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:40.509227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 836/1686] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:40.512105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:40.539521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7825ad61-0052-412a-95c6-55ad243938b3 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:40.553473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:40.554387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:40.554671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:40.554946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:40.558744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:40.561340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:40.629518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 837/1687] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:40 2022] POST /identity/v3/projects => generated 377 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:40.646364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:40.648314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:40.650416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:40.678352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 851/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 646 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:40.800451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686adfd-6a8e-46ae-8857-8e8128c369ea admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:40.833859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:40.835620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:40.835920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:40.838535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:40.842632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:40.846567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:40.916451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 838/1689] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:40 2022] POST /identity/v3/users => generated 289 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:40.918082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:40.963076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c261e4-aa6b-4719-8834-025b323bbc94 service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:40.992589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e81cd2-393a-4f8b-9f27-b7d050820439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:40.994791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81cd2-393a-4f8b-9f27-b7d050820439 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:41.002002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81cd2-393a-4f8b-9f27-b7d050820439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:41.002684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e81cd2-393a-4f8b-9f27-b7d050820439 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:41.004422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e81cd2-393a-4f8b-9f27-b7d050820439 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:41.011375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e81cd2-393a-4f8b-9f27-b7d050820439 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:41.045342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 852/1690] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:51:41.046879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:41.066142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc2427b-8080-4d3c-a30c-0c49cf61289c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:41.084058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:41.085291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:41.085780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:41.086404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:41.087357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:41.106004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:41.123299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:41.125514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:41.125828 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:41.135850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 839/1691] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:41 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:41.139666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:41.151721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3bda24-02fe-4faa-8780-dc9a0cb39dc8 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:41.158512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:41.159563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:41.159855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:41.160139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] PATH_INFO: `/v3/projects/dff4714a1ca34147aeb638e9d010e73c/users/d89f470823d746fd9df7c64b669f7103/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:41.184842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff4714a1ca34147aeb638e9d010e73c, user_id=d89f470823d746fd9df7c64b669f7103, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:41.189515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:41.218104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] MFA Rules not processed for user `fc4e06c1371340a98c2c76457aa74b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:41.221349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:41.235770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 840/1692] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:41 2022] PUT /identity/v3/projects/dff4714a1ca34147aeb638e9d010e73c/users/d89f470823d746fd9df7c64b669f7103/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:41.238266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:41.243198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:41.398935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:41.442044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 853/1693] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:41.444693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:41.448874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:41.491076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea2465-45b1-4075-9431-d695acdacb84 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:41.504747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923994b-6236-4c1d-86c7-f5dac7d8cf50 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:41.507960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:41.511028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:41.511525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:41.513032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] PATH_INFO: `/v3/projects/808d6a81906842df87aed074f50318fa` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:41.516520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=808d6a81906842df87aed074f50318fa)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:41.520165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:41.525951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:41.527724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:41.528791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:41.529181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] PATH_INFO: `/v3/projects/b60a9115dcc94313b1741fd83baa371b` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:41.531626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60a9115dcc94313b1741fd83baa371b)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:41.539813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:41.556371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:41.616563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60a9115dcc94313b1741fd83baa371b', 'request_id': 'req-b9968731-3398-4df0-808d-f0463e03b884'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.636534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60a9115dcc94313b1741fd83baa371b', 'request_id': 'req-b9968731-3398-4df0-808d-f0463e03b884'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.650388 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '808d6a81906842df87aed074f50318fa', 'request_id': 'req-a8fb0205-76ba-4427-b6c6-efa47df78cf5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.666631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60a9115dcc94313b1741fd83baa371b', 'request_id': 'req-b9968731-3398-4df0-808d-f0463e03b884'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.670918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '808d6a81906842df87aed074f50318fa', 'request_id': 'req-a8fb0205-76ba-4427-b6c6-efa47df78cf5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.694895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '808d6a81906842df87aed074f50318fa', 'request_id': 'req-a8fb0205-76ba-4427-b6c6-efa47df78cf5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.707400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] The token cache is being invalidate because project b60a9115dcc94313b1741fd83baa371b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:41.711946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.714305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9968731-3398-4df0-808d-f0463e03b884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.723798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 854/1694] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:41 2022] DELETE /identity/v3/projects/b60a9115dcc94313b1741fd83baa371b => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:41.728507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:41.729491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] The token cache is being invalidate because project 808d6a81906842df87aed074f50318fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:41.730318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:41.730711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:41.731898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.735522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:41.743348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 841/1695] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:41 2022] DELETE /identity/v3/projects/808d6a81906842df87aed074f50318fa => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:41.744791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:41.748912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:41.808813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] MFA Rules not processed for user `d89f470823d746fd9df7c64b669f7103`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:41.813437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:41.993849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb0205-76ba-4427-b6c6-efa47df78cf5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:42.047573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7c8a84-ecbf-43ca-ba6a-7c534bdbd777 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:42.048275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8a84-ecbf-43ca-ba6a-7c534bdbd777 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:42.052893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8a84-ecbf-43ca-ba6a-7c534bdbd777 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:42.052893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7c8a84-ecbf-43ca-ba6a-7c534bdbd777 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:42.057422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3f7c8a84-ecbf-43ca-ba6a-7c534bdbd777 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:42.077157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 855/1696] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:42.077900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:42.079402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:42.277032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967d0087-49b9-4dab-b3db-67873209d296 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:42.284003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:42.285568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:42.285568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:42.285747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] PATH_INFO: `/v3/users/d0bd6b27d9804007a25ab77c6979bee2` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:42.287262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0bd6b27d9804007a25ab77c6979bee2)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:42.289532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:42.345228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c8a84-ecbf-43ca-ba6a-7c534bdbd777 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:42.357412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7c8a84-ecbf-43ca-ba6a-7c534bdbd777 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:42.363249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:42.389121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0bd6b27d9804007a25ab77c6979bee2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.406978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0bd6b27d9804007a25ab77c6979bee2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.411971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 842/1697] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:41 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 667 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:42.415549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:42.415844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:42.416187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:42.450794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0bd6b27d9804007a25ab77c6979bee2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.452107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0bd6b27d9804007a25ab77c6979bee2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.470972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:42.472270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:42.474478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0bd6b27d9804007a25ab77c6979bee2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.486721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 856/1698] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:42 2022] DELETE /identity/v3/users/d0bd6b27d9804007a25ab77c6979bee2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:42.489609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:42.493888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:42.504541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 843/1699] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:42.504541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:42.509480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:42.555351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73d1035-7257-41dc-ae01-fbeea6a2a31d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:42.569277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:42.741672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4bfaab-f9cf-4ce6-9743-092e44f4f987 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:42.769132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:42.769959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:42.770096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:42.776824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:42.777618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:42.783728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:42.784636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:42.784925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:42.785204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] PATH_INFO: `/v3/projects/d90a020be2274d5195715a044898c0ad` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:42.786839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d90a020be2274d5195715a044898c0ad)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:42.788843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:42.796784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:42.870505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 857/1700] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:42 2022] POST /identity/v3/projects => generated 375 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:42.871735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:42.878693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:42.921245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd90a020be2274d5195715a044898c0ad', 'request_id': 'req-8d3d20ef-05b9-4c25-841f-28d67ce600d7'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.930013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd90a020be2274d5195715a044898c0ad', 'request_id': 'req-8d3d20ef-05b9-4c25-841f-28d67ce600d7'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.948732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd90a020be2274d5195715a044898c0ad', 'request_id': 'req-8d3d20ef-05b9-4c25-841f-28d67ce600d7'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.973680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] The token cache is being invalidate because project d90a020be2274d5195715a044898c0ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:42.975896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.976707 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8d3d20ef-05b9-4c25-841f-28d67ce600d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:42.987162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 844/1701] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:42 2022] DELETE /identity/v3/projects/d90a020be2274d5195715a044898c0ad => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:42.987162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:42.987904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:42.987904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.052005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0101e67-6706-4e9d-b1f2-0c3184685bfe admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:43.060508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:43.064209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.127432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:43.167782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:43.169879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.170455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.170766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] PATH_INFO: `/v3/projects/fa1ffda55a794cb59d95949197248b39` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.172154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa1ffda55a794cb59d95949197248b39)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:43.174609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:43.278541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 845/1702] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:43.278541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:43.281831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.291834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa1ffda55a794cb59d95949197248b39', 'request_id': 'req-50260d05-afb2-46aa-ab8e-1663b89e9af9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:43.307065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa1ffda55a794cb59d95949197248b39', 'request_id': 'req-50260d05-afb2-46aa-ab8e-1663b89e9af9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:43.328005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5804ec-6d4d-4acf-8d4d-fa775c9021c2 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:43.336671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa1ffda55a794cb59d95949197248b39', 'request_id': 'req-50260d05-afb2-46aa-ab8e-1663b89e9af9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:43.382483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] The token cache is being invalidate because project fa1ffda55a794cb59d95949197248b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:43.382924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:43.388635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-50260d05-afb2-46aa-ab8e-1663b89e9af9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:43.389809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:43.391533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 858/1703] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:42 2022] DELETE /identity/v3/projects/fa1ffda55a794cb59d95949197248b39 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:43.399429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.399652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.399869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.433818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f907978-ff58-4ad4-871f-85e3c4f79cde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:43.435801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907978-ff58-4ad4-871f-85e3c4f79cde admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.436317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907978-ff58-4ad4-871f-85e3c4f79cde admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.439260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f907978-ff58-4ad4-871f-85e3c4f79cde admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.440266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f907978-ff58-4ad4-871f-85e3c4f79cde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:43.443396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f907978-ff58-4ad4-871f-85e3c4f79cde admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:43.444686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:43.446150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.474715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 859/1704] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:43.475736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:43.485524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.486814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 846/1705] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:43 2022] POST /identity/v3/users => generated 294 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:43.491729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.492032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.492314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.508341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032fa336-34fd-40a1-98ed-ed60ebb1bfbf None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:43.524734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7f322-4e90-4fd1-9b5a-b9654d05554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:43.525438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7f322-4e90-4fd1-9b5a-b9654d05554d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.525731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7f322-4e90-4fd1-9b5a-b9654d05554d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.526030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7f322-4e90-4fd1-9b5a-b9654d05554d admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.526802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7f322-4e90-4fd1-9b5a-b9654d05554d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:43.527144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7f322-4e90-4fd1-9b5a-b9654d05554d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:43.528915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7f322-4e90-4fd1-9b5a-b9654d05554d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:43.545604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:43.546868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.564646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 860/1706] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:43.566408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053778-4482-424e-bcdb-94a43c2c130d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.566718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053778-4482-424e-bcdb-94a43c2c130d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.567009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b053778-4482-424e-bcdb-94a43c2c130d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.574666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 847/1707] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:43.575746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:43.586158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.618619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964dfc49-18b0-4d39-8fab-fea77d3b595f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:43.639475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4b3cf4-3784-417f-aa65-c692efbd6047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:43.639992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3cf4-3784-417f-aa65-c692efbd6047 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.644221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3cf4-3784-417f-aa65-c692efbd6047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.645401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4b3cf4-3784-417f-aa65-c692efbd6047 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.648702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3cf4-3784-417f-aa65-c692efbd6047 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:43.650093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4b053778-4482-424e-bcdb-94a43c2c130d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:43.651368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4b053778-4482-424e-bcdb-94a43c2c130d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.656768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4b3cf4-3784-417f-aa65-c692efbd6047 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:43.676504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 861/1708] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:43.676504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053778-4482-424e-bcdb-94a43c2c130d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:43.699538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b053778-4482-424e-bcdb-94a43c2c130d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:43.710252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:43.710949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.711240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.711526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.712233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:43.712506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 848/1709] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:43 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:43.714458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c701-c1ac-4896-80b2-fc5905461f79 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:43.714458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c701-c1ac-4896-80b2-fc5905461f79 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:43.714670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4c701-c1ac-4896-80b2-fc5905461f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:43.721689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:43.775039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-eaa4c701-c1ac-4896-80b2-fc5905461f79 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:43.782481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-eaa4c701-c1ac-4896-80b2-fc5905461f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:43.790484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 862/1710] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:43 2022] POST /identity/v3/projects => generated 407 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:43.791650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:43.797070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:44.039394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfcc777-d499-443b-837a-d7bc3acc9033 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.044639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 849/1711] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:44.047949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c701-c1ac-4896-80b2-fc5905461f79 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.058496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:44.059911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.060204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.060543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] PATH_INFO: `/v3/projects/c17b70c2d29441fdb340232aefc8cefb` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.065801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c17b70c2d29441fdb340232aefc8cefb)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:44.071053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:44.084370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4c701-c1ac-4896-80b2-fc5905461f79 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.099873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:44.100759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.102025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.102322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.105295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:44.105657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:44.112873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:44.169428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 850/1712] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:44.172220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.181818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:44.208343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c17b70c2d29441fdb340232aefc8cefb', 'request_id': 'req-1bb5588e-e9d1-4621-a4fb-931263814788'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:44.214082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fb4c93-6dcf-4c43-9f40-94c93fd208e8 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.222368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c17b70c2d29441fdb340232aefc8cefb', 'request_id': 'req-1bb5588e-e9d1-4621-a4fb-931263814788'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:44.233626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c17b70c2d29441fdb340232aefc8cefb', 'request_id': 'req-1bb5588e-e9d1-4621-a4fb-931263814788'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:44.252951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] The token cache is being invalidate because project c17b70c2d29441fdb340232aefc8cefb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:44.255193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:44.257316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:44.264257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 863/1713] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:43 2022] DELETE /identity/v3/projects/c17b70c2d29441fdb340232aefc8cefb => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:44.265943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.268409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:44.386310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:44.387553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.387745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5588e-e9d1-4621-a4fb-931263814788 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.388099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.388777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] PATH_INFO: `/v3/projects/99c4dcbd4e65451d877c5b269ae6859e/users/e06c68b6688b4534a38ca8c138a1b73a/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.401052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:44.401760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.402051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.402333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.403321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:44.405531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:44.421755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c4dcbd4e65451d877c5b269ae6859e, user_id=e06c68b6688b4534a38ca8c138a1b73a, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:44.425347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:44.461712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 864/1714] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:44 2022] POST /identity/v3/users => generated 304 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:44.462733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.464895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:44.482151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c46467-d34f-4adc-aa17-1667944f00b3 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.493664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 851/1715] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:44 2022] PUT /identity/v3/projects/99c4dcbd4e65451d877c5b269ae6859e/users/e06c68b6688b4534a38ca8c138a1b73a/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:44.507516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.515545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:44.630060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:44.640084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c324f3b4-d81c-437a-a3f1-cbfe5133af61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:44.640846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f3b4-d81c-437a-a3f1-cbfe5133af61 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.641143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f3b4-d81c-437a-a3f1-cbfe5133af61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.641429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324f3b4-d81c-437a-a3f1-cbfe5133af61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.642370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324f3b4-d81c-437a-a3f1-cbfe5133af61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:44.642699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324f3b4-d81c-437a-a3f1-cbfe5133af61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:44.644464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c324f3b4-d81c-437a-a3f1-cbfe5133af61 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:44.686569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 865/1716] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:44.691749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86bcfd-a2c6-4be0-8279-e2983f71f0e1 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.692050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86bcfd-a2c6-4be0-8279-e2983f71f0e1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.692336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86bcfd-a2c6-4be0-8279-e2983f71f0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.738837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9d86bcfd-a2c6-4be0-8279-e2983f71f0e1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:44.740142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9d86bcfd-a2c6-4be0-8279-e2983f71f0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:44.751517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785e32f3-d331-4ec0-923e-58e6cdc1b49a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.766967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 866/1717] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:44.766967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86bcfd-a2c6-4be0-8279-e2983f71f0e1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.767237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:44.767237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.767237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.767237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.767479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:44.775276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:44.792366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d86bcfd-a2c6-4be0-8279-e2983f71f0e1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.807361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617095df-350e-4044-9469-7379e8452622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:44.808157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617095df-350e-4044-9469-7379e8452622 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:44.808630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617095df-350e-4044-9469-7379e8452622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:44.810446 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617095df-350e-4044-9469-7379e8452622 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:44.814064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617095df-350e-4044-9469-7379e8452622 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:44.817330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617095df-350e-4044-9469-7379e8452622 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:44.847293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 852/1718] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:44 2022] POST /identity/v3/projects => generated 355 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:44.848220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.849329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 867/1719] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:44.850308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617095df-350e-4044-9469-7379e8452622 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:44.853593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:44.876061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617095df-350e-4044-9469-7379e8452622 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:44.921323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:45.011256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9704f6-a656-4555-9f13-7f2bca173eb0 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.013051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.013736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.014169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.014478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.015695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.018090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.025783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e696711-641e-49d9-8893-40fd7c89db54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.026474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e696711-641e-49d9-8893-40fd7c89db54 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.027138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e696711-641e-49d9-8893-40fd7c89db54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.027366 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e696711-641e-49d9-8893-40fd7c89db54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.028174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e696711-641e-49d9-8893-40fd7c89db54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.033035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e696711-641e-49d9-8893-40fd7c89db54 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.057021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 853/1720] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:45.063083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62a78-c202-4971-86d7-e8e89d5cbbdb None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.063083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62a78-c202-4971-86d7-e8e89d5cbbdb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.063463 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e62a78-c202-4971-86d7-e8e89d5cbbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.077419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 868/1721] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:44 2022] POST /identity/v3/projects => generated 363 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:45.078524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.114579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e9e62a78-c202-4971-86d7-e8e89d5cbbdb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:45.116052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e9e62a78-c202-4971-86d7-e8e89d5cbbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:45.169564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6848c-1ab2-4fec-aba7-c0c9c2ed8899 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.176157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.177195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.177764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.178207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.179130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.184908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.222051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 869/1722] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:45 2022] POST /identity/v3/users => generated 278 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:45.223336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.239126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea8668a-47d6-40aa-b6bc-3ff38d779113 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.251955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.252957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.253340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.253711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.254550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.256503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.269337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 870/1723] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:45.270410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.277274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 854/1724] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:45.277274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e62a78-c202-4971-86d7-e8e89d5cbbdb None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.282447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef259b-afd6-4364-867e-b72a24384e58 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.290192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.290192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.290192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.290192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] PATH_INFO: `/v3/projects/99c4dcbd4e65451d877c5b269ae6859e/users/e06c68b6688b4534a38ca8c138a1b73a/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.291759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99c4dcbd4e65451d877c5b269ae6859e, user_id=e06c68b6688b4534a38ca8c138a1b73a, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.295049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.306921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e62a78-c202-4971-86d7-e8e89d5cbbdb None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.326545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 871/1725] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:45 2022] PUT /identity/v3/projects/99c4dcbd4e65451d877c5b269ae6859e/users/e06c68b6688b4534a38ca8c138a1b73a/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:45.327351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.414945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:45.453136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0ec0e8-965d-4f98-8307-3f749d04f8c7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.466957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.467691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.467984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.468265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.470305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.471630 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.472943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.473472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.473883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.475229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.477157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.481031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.507421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 872/1726] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:45.508111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.538395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 855/1727] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:45 2022] POST /identity/v3/users => generated 282 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:45.539441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.552145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66227ac-9788-4965-98e5-4a50e0d3ce30 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.566124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8412fb9-5fb8-42fe-9a8f-82d52657c7fd admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.576296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.576864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.577154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.577437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] PATH_INFO: `/v3/projects/ea2a6e5c3b6a432aa81505ac1e880e24/users/88bd2047df7c410aa5c12c37c81b0278/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.588241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c5623-56ef-415a-a271-e7d5b22fe0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.589145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:45.589588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c5623-56ef-415a-a271-e7d5b22fe0fa admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.590573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c5623-56ef-415a-a271-e7d5b22fe0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.591329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c5623-56ef-415a-a271-e7d5b22fe0fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.592731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c5623-56ef-415a-a271-e7d5b22fe0fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:51:45.593817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c5623-56ef-415a-a271-e7d5b22fe0fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.598932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c5623-56ef-415a-a271-e7d5b22fe0fa admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.630928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea2a6e5c3b6a432aa81505ac1e880e24, user_id=88bd2047df7c410aa5c12c37c81b0278, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.639262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.660529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 856/1728] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:51:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:51:45.660529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103ef6-97c6-4c0e-9039-27cc1ca59c67 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.660529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103ef6-97c6-4c0e-9039-27cc1ca59c67 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.660529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca103ef6-97c6-4c0e-9039-27cc1ca59c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.676763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 873/1729] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:45 2022] PUT /identity/v3/projects/ea2a6e5c3b6a432aa81505ac1e880e24/users/88bd2047df7c410aa5c12c37c81b0278/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:45.682768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.735078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ca103ef6-97c6-4c0e-9039-27cc1ca59c67 None None] MFA Rules not processed for user `e06c68b6688b4534a38ca8c138a1b73a`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:45.736910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ca103ef6-97c6-4c0e-9039-27cc1ca59c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:45.852804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1b1fa-b7d4-49d5-8562-2ae72cb3a88a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.865444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.866150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.866440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.866953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.867773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.869458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.892104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 874/1730] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:45.893107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.901728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 857/1731] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:45.904285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca103ef6-97c6-4c0e-9039-27cc1ca59c67 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:45.930879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a3bfc3-a840-40b0-8433-b359f31fa496 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.937420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca103ef6-97c6-4c0e-9039-27cc1ca59c67 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:45.937601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ec32a-c44a-4241-b65d-a8da976b76aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.938109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec32a-c44a-4241-b65d-a8da976b76aa admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.938398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec32a-c44a-4241-b65d-a8da976b76aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.938679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ec32a-c44a-4241-b65d-a8da976b76aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.939634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ec32a-c44a-4241-b65d-a8da976b76aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.944456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ec32a-c44a-4241-b65d-a8da976b76aa admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.955159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:45.955873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.956212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.958603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:45.960600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:45.964096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 875/1732] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:45.965526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:45.974701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:45.975527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:45.976253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.037105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] MFA Rules not processed for user `88bd2047df7c410aa5c12c37c81b0278`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:46.039128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:46.041914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 858/1733] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:45 2022] POST /identity/v3/projects => generated 379 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:46.042959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:46.200353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95dfa5eb-194c-4edc-9567-08ac380d597a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:46.206370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 876/1734] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:45 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:46.207336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:46.209620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:46.212689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:46.215015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.216173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.216808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] PATH_INFO: `/v3/projects/86eed8aa8bea49c19bdec2e9ff6aaf46/users/4dfb6450ccef41b1b121b46340114fa6/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.249393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86eed8aa8bea49c19bdec2e9ff6aaf46, user_id=4dfb6450ccef41b1b121b46340114fa6, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:46.253847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:46.294354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 859/1735] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:46 2022] PUT /identity/v3/projects/86eed8aa8bea49c19bdec2e9ff6aaf46/users/4dfb6450ccef41b1b121b46340114fa6/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:46.295790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:46.307056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:46.377962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a8327-554c-4240-8ece-b97de5aacee7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:46.392640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:46.446466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad1e826-9faa-4017-bc57-fe08c50e0398 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:46.453049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:46.453950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.454655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.455089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.455986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:46.458383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:46.463417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764421b6-d92d-4e5a-99d4-1c7c7f59615f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:46.466042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764421b6-d92d-4e5a-99d4-1c7c7f59615f service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.466403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764421b6-d92d-4e5a-99d4-1c7c7f59615f service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.466841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764421b6-d92d-4e5a-99d4-1c7c7f59615f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.469337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-764421b6-d92d-4e5a-99d4-1c7c7f59615f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:46.472814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 860/1736] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:46.473952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:46.487461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf046816-a697-4352-a707-53c50a99cae8 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:46.494641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:46.495650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.496083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.496605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.497485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:46.499860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:46.549969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 861/1737] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:46 2022] POST /identity/v3/users => generated 290 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:46.551485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:46.568442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a65897-be02-4c5c-a897-33a73eca1c30 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:46.574025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7108ddb1-25a7-4869-b90f-5a594ab7a525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:46.576225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108ddb1-25a7-4869-b90f-5a594ab7a525 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.576719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108ddb1-25a7-4869-b90f-5a594ab7a525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.577145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7108ddb1-25a7-4869-b90f-5a594ab7a525 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.578173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108ddb1-25a7-4869-b90f-5a594ab7a525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:46.580690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7108ddb1-25a7-4869-b90f-5a594ab7a525 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:46.597921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764421b6-d92d-4e5a-99d4-1c7c7f59615f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:46.599417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764421b6-d92d-4e5a-99d4-1c7c7f59615f service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:46.621476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 877/1738] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:46.627226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ff2b-a19e-4bc7-88a6-8fde1898990d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.650168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ff2b-a19e-4bc7-88a6-8fde1898990d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.652510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4421ff2b-a19e-4bc7-88a6-8fde1898990d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.675750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 862/1739] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:46 2022] POST /identity/v3/projects => generated 409 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:46.679453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f09e5-c93a-499d-a163-7ab8df289f07 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.679903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f09e5-c93a-499d-a163-7ab8df289f07 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.680340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f09e5-c93a-499d-a163-7ab8df289f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:46.719334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-307f09e5-c93a-499d-a163-7ab8df289f07 None None] MFA Rules not processed for user `fc4e06c1371340a98c2c76457aa74b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:46.722242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-307f09e5-c93a-499d-a163-7ab8df289f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:46.782675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4421ff2b-a19e-4bc7-88a6-8fde1898990d None None] MFA Rules not processed for user `4dfb6450ccef41b1b121b46340114fa6`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:46.784033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4421ff2b-a19e-4bc7-88a6-8fde1898990d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:46.832903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 863/1740] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:46.836822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f09e5-c93a-499d-a163-7ab8df289f07 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:46.990710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 878/1741] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:46 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:46.990710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ff2b-a19e-4bc7-88a6-8fde1898990d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:46.991072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f09e5-c93a-499d-a163-7ab8df289f07 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:46.996189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:46.998695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:46.998998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:46.999281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] PATH_INFO: `/v3/projects/660b5d4634f64a548b54c7629a5146d4/users/cfe4b448fae64387a1b373af40aeaf2b/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.018392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:47.021113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4421ff2b-a19e-4bc7-88a6-8fde1898990d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:47.026447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] RBAC: Authorizing `identity:create_grant(project_id=660b5d4634f64a548b54c7629a5146d4, user_id=cfe4b448fae64387a1b373af40aeaf2b, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:47.036438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282149e0-6edb-4baf-91e1-c5ba8e16888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:47.037737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282149e0-6edb-4baf-91e1-c5ba8e16888a admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.044944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282149e0-6edb-4baf-91e1-c5ba8e16888a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.048975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:47.058267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282149e0-6edb-4baf-91e1-c5ba8e16888a admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.060236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282149e0-6edb-4baf-91e1-c5ba8e16888a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:47.065468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282149e0-6edb-4baf-91e1-c5ba8e16888a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:47.088429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 864/1742] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:46 2022] PUT /identity/v3/projects/660b5d4634f64a548b54c7629a5146d4/users/cfe4b448fae64387a1b373af40aeaf2b/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:47.088429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:47.126384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 879/1743] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:47.129246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d0990-96e3-4276-bb7e-f9f842bbe5fe None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.133682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d0990-96e3-4276-bb7e-f9f842bbe5fe None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.134338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7d0990-96e3-4276-bb7e-f9f842bbe5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.191298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c35cef7-f37a-471b-9f20-189cc4983bff admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:47.202499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-ce7d0990-96e3-4276-bb7e-f9f842bbe5fe None None] MFA Rules not processed for user `2a859567189a41e2b7edd6a2e17f87c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:47.204713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ce7d0990-96e3-4276-bb7e-f9f842bbe5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:47.204994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:47.205779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.206072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.207191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.207368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:47.210259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:47.248845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 865/1744] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:47 2022] POST /identity/v3/users => generated 311 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:47.254084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:47.279346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5348f144-690e-49c8-9ce5-b403cef330e7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:47.285554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf1d46b-f5e3-4cb0-a783-56471594b590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:47.286161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d46b-f5e3-4cb0-a783-56471594b590 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.286451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d46b-f5e3-4cb0-a783-56471594b590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.286734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf1d46b-f5e3-4cb0-a783-56471594b590 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.287461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1d46b-f5e3-4cb0-a783-56471594b590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:47.289556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf1d46b-f5e3-4cb0-a783-56471594b590 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:47.328860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 866/1745] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:47 2022] POST /identity/v3/projects => generated 355 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:47.330505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad717b7-2e75-4990-9bd1-9483f57e8e44 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.330895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad717b7-2e75-4990-9bd1-9483f57e8e44 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.331764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad717b7-2e75-4990-9bd1-9483f57e8e44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.385436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:47.396396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-aad717b7-2e75-4990-9bd1-9483f57e8e44 None None] MFA Rules not processed for user `07e1ed7064424abdbbd04cdf0b030fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:47.404778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-aad717b7-2e75-4990-9bd1-9483f57e8e44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:47.435368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 880/1746] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:47.445399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5864f-9051-4224-b424-b060d54139c5 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.445931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5864f-9051-4224-b424-b060d54139c5 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.446280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b5864f-9051-4224-b424-b060d54139c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.520430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f9b5864f-9051-4224-b424-b060d54139c5 None None] MFA Rules not processed for user `cfe4b448fae64387a1b373af40aeaf2b`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:47.522124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f9b5864f-9051-4224-b424-b060d54139c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:47.626817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 867/1747] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:47.627606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad717b7-2e75-4990-9bd1-9483f57e8e44 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:47.757321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 881/1748] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:47.760949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5864f-9051-4224-b424-b060d54139c5 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:47.804325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:47.863622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad717b7-2e75-4990-9bd1-9483f57e8e44 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:47.878014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:47.878452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.879517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.880360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.880767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:47.892577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:47.942452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 868/1749] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:47.943071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:47.968195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6403fe2-2d61-431e-8079-3650feb2d848 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:47.986670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:47.987387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:47.987680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:47.987961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:47.988711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:47.993666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b5864f-9051-4224-b424-b060d54139c5 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:47.997634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.006666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466bb6d1-bc76-4417-b653-453dfe6ffcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.007430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bb6d1-bc76-4417-b653-453dfe6ffcc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.007732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bb6d1-bc76-4417-b653-453dfe6ffcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.008017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466bb6d1-bc76-4417-b653-453dfe6ffcc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.009956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bb6d1-bc76-4417-b653-453dfe6ffcc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.015798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466bb6d1-bc76-4417-b653-453dfe6ffcc7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.041803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 882/1750] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:48.041803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0c946-509b-41a1-a1cc-b464606182d7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.042391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0c946-509b-41a1-a1cc-b464606182d7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.042798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba0c946-509b-41a1-a1cc-b464606182d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.047995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 869/1751] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:47 2022] POST /identity/v3/users => generated 284 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:48.049086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.062771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9223e50-bd4b-42bc-9001-163f8e428a8d admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.068236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.069014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.069368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.069713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.070464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bba0c946-509b-41a1-a1cc-b464606182d7 None None] MFA Rules not processed for user `07e1ed7064424abdbbd04cdf0b030fd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:48.070590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.071848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bba0c946-509b-41a1-a1cc-b464606182d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:48.072906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.086273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 883/1752] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:48.087380 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0c946-509b-41a1-a1cc-b464606182d7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.106610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba0c946-509b-41a1-a1cc-b464606182d7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.116536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.117966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.119408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.120632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] PATH_INFO: `/v3/projects/2c5b5d1617b14cc5ba96607ca59ef43c/users/ef23ed0ac41f4153aa27bc02e5637f28/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.133787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 870/1753] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:48 2022] POST /identity/v3/projects => generated 365 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:48.134885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.163564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c5b5d1617b14cc5ba96607ca59ef43c, user_id=ef23ed0ac41f4153aa27bc02e5637f28, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.173091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.231170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 884/1754] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:48 2022] PUT /identity/v3/projects/2c5b5d1617b14cc5ba96607ca59ef43c/users/ef23ed0ac41f4153aa27bc02e5637f28/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:48.232295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.290686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085f2d3-4f26-4c05-920d-c0086e59b7aa admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.366444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:48.404608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb70f46-5760-423a-a251-c978e59bcda5 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.420435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.421134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.421429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.421717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.422622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.424413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.437213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9509a5dd-3ef0-4885-8afb-d1c1361443da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.438394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a5dd-3ef0-4885-8afb-d1c1361443da admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.438965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a5dd-3ef0-4885-8afb-d1c1361443da admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.439403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9509a5dd-3ef0-4885-8afb-d1c1361443da admin admin] PATH_INFO: `/v3/projects/47e2cbfc965a4d0684c4eee30fe33201/users/1f55865845384ef3826de6f357476c0b/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.452233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 885/1755] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:48.452233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.461680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff562217-1f44-433b-bacf-0d6131774e16 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.466581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509a5dd-3ef0-4885-8afb-d1c1361443da admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e2cbfc965a4d0684c4eee30fe33201, user_id=1f55865845384ef3826de6f357476c0b, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.468541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59769f6f-b67b-4480-aa9c-a83e4d209cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.469263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769f6f-b67b-4480-aa9c-a83e4d209cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.469622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769f6f-b67b-4480-aa9c-a83e4d209cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.470008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59769f6f-b67b-4480-aa9c-a83e4d209cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.470376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9509a5dd-3ef0-4885-8afb-d1c1361443da admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.470848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769f6f-b67b-4480-aa9c-a83e4d209cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.473005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59769f6f-b67b-4480-aa9c-a83e4d209cf9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.501065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 871/1756] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:48 2022] PUT /identity/v3/projects/47e2cbfc965a4d0684c4eee30fe33201/users/1f55865845384ef3826de6f357476c0b/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:48.502712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995967-e079-490b-b012-d84985f008b5 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.502995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995967-e079-490b-b012-d84985f008b5 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.503444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c995967-e079-490b-b012-d84985f008b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.516091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 886/1757] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:48 2022] POST /identity/v3/users => generated 289 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:48.522100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f52d0-a8f6-473d-90b0-66c604138271 None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.523066 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f52d0-a8f6-473d-90b0-66c604138271 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.523594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f52d0-a8f6-473d-90b0-66c604138271 None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.525815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 887/1758] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 30 12:51:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:51:48.527231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f52d0-a8f6-473d-90b0-66c604138271 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.552905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6c995967-e079-490b-b012-d84985f008b5 None None] MFA Rules not processed for user `ef23ed0ac41f4153aa27bc02e5637f28`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:48.554116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6c995967-e079-490b-b012-d84985f008b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:48.587339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:48.630374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f52d0-a8f6-473d-90b0-66c604138271 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.636606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.638383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.638863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.639323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] PATH_INFO: `/v3/projects/85bbd397581e431a84ff0a2a757d2db0/users/e1c621a345b748be9c162dc3bb343240/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.659701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bbd397581e431a84ff0a2a757d2db0, user_id=e1c621a345b748be9c162dc3bb343240, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.663763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.670352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 872/1759] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:48.672716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ffe76-ed52-4f17-834a-c2c98ea6050e None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.673183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ffe76-ed52-4f17-834a-c2c98ea6050e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.673473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87ffe76-ed52-4f17-834a-c2c98ea6050e None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.676066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 873/1760] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 30 12:51:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:51:48.676966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ffe76-ed52-4f17-834a-c2c98ea6050e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.695706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87ffe76-ed52-4f17-834a-c2c98ea6050e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.702875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 888/1761] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:48 2022] PUT /identity/v3/projects/85bbd397581e431a84ff0a2a757d2db0/users/e1c621a345b748be9c162dc3bb343240/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:48.702875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.777206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a3e66a-2216-4128-a9ec-de7325212531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.778814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e66a-2216-4128-a9ec-de7325212531 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.778814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e66a-2216-4128-a9ec-de7325212531 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.779213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a3e66a-2216-4128-a9ec-de7325212531 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.780541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3e66a-2216-4128-a9ec-de7325212531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.782539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a3e66a-2216-4128-a9ec-de7325212531 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.796083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 874/1762] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:48.798208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce539006-df51-4791-bbf7-2023160dae6a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.798743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce539006-df51-4791-bbf7-2023160dae6a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.798896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce539006-df51-4791-bbf7-2023160dae6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.802877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c4bc3-9b03-47ed-8c36-f598092fc57c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.808870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.810670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.811067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.811440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.812293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.814132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.832751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 889/1763] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:48.833820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.846716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a859f-8003-411f-a294-682524e26ffc admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.847220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ce539006-df51-4791-bbf7-2023160dae6a None None] MFA Rules not processed for user `b35298e764904e9884012cafea48a794`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:48.848551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ce539006-df51-4791-bbf7-2023160dae6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:48.856304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a244-10ce-4a3d-9527-fc17105aee08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:48.857319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a244-10ce-4a3d-9527-fc17105aee08 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.858134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a244-10ce-4a3d-9527-fc17105aee08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.858557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a244-10ce-4a3d-9527-fc17105aee08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.860258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a244-10ce-4a3d-9527-fc17105aee08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:48.863335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a244-10ce-4a3d-9527-fc17105aee08 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:48.908683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 890/1764] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:51:48 2022] POST /identity/v3/projects => generated 379 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:48.910948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea2418-66cb-45e2-9e23-c06cc88fd1ed None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:48.912188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea2418-66cb-45e2-9e23-c06cc88fd1ed None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:48.912188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbea2418-66cb-45e2-9e23-c06cc88fd1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:48.922646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 875/1765] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:48.923849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce539006-df51-4791-bbf7-2023160dae6a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:48.937705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce539006-df51-4791-bbf7-2023160dae6a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:48.939576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-dbea2418-66cb-45e2-9e23-c06cc88fd1ed None None] MFA Rules not processed for user `b35298e764904e9884012cafea48a794`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:48.941519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-dbea2418-66cb-45e2-9e23-c06cc88fd1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:48.967022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:49.019534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:49.027782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 891/1766] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:51:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:49.029101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.029525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea2418-66cb-45e2-9e23-c06cc88fd1ed None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.030315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.030315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.030315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.031646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.040629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.057619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 876/1767] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:49.057619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.064829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbea2418-66cb-45e2-9e23-c06cc88fd1ed None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.072310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855d85a-146a-48a0-9a8d-2161fe3b6f05 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.077026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.078139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.078601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.078990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.079142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] PATH_INFO: `/v3/projects/47e2cbfc965a4d0684c4eee30fe33201/users/1f55865845384ef3826de6f357476c0b/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.080017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.080365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.080697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] PATH_INFO: `/v3/projects/504e06b411f24e3aa6a77c58abce066f/users/b0d6e2db8f5e45988d1ba62d869bb50d/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.084370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47e2cbfc965a4d0684c4eee30fe33201, user_id=1f55865845384ef3826de6f357476c0b, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.088887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.106979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 892/1768] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:49 2022] PUT /identity/v3/projects/47e2cbfc965a4d0684c4eee30fe33201/users/1f55865845384ef3826de6f357476c0b/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:49.108335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.110779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] RBAC: Authorizing `identity:create_grant(project_id=504e06b411f24e3aa6a77c58abce066f, user_id=b0d6e2db8f5e45988d1ba62d869bb50d, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.113784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.142299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 877/1769] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:49 2022] PUT /identity/v3/projects/504e06b411f24e3aa6a77c58abce066f/users/b0d6e2db8f5e45988d1ba62d869bb50d/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:49.143799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.147642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:49.266861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6773e2-a822-47bc-9746-c5f07a7b0dae admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.280284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.281149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7728b47-0ce2-463a-92b1-af82580fd6f2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.282927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.284501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.284964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.321421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.326098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.352682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 878/1770] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:49.354680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.363174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:49.383174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9859911b-3b12-4e97-b2f4-cd1fc4eb345b service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.386964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a9826-f64a-495c-a0d6-d4376b6a0379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.388004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a9826-f64a-495c-a0d6-d4376b6a0379 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.389630 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.391396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.391396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.391396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.392434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a9826-f64a-495c-a0d6-d4376b6a0379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.392982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a9826-f64a-495c-a0d6-d4376b6a0379 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.394729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a9826-f64a-495c-a0d6-d4376b6a0379 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.401083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16a9826-f64a-495c-a0d6-d4376b6a0379 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.404058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.406029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.436981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 879/1771] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:49.438020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.460838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 893/1772] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:51:49 2022] POST /identity/v3/users => generated 296 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:51:49.462595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eced4f-bc78-4dbc-b7ef-e49165ff1ae3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.463592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eced4f-bc78-4dbc-b7ef-e49165ff1ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.464171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eced4f-bc78-4dbc-b7ef-e49165ff1ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.470045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d732c9-06f2-43cd-b439-26a542fb2549 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.494529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.495605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.495947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.496339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] PATH_INFO: `/v3/projects/85bbd397581e431a84ff0a2a757d2db0/users/e1c621a345b748be9c162dc3bb343240/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.500503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85bbd397581e431a84ff0a2a757d2db0, user_id=e1c621a345b748be9c162dc3bb343240, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.520042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.521572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-64eced4f-bc78-4dbc-b7ef-e49165ff1ae3 None None] MFA Rules not processed for user `1f55865845384ef3826de6f357476c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:49.524169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-64eced4f-bc78-4dbc-b7ef-e49165ff1ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:49.569457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 880/1773] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:49 2022] PUT /identity/v3/projects/85bbd397581e431a84ff0a2a757d2db0/users/e1c621a345b748be9c162dc3bb343240/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:49.582815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.626172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:49.703751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 894/1774] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:49.704879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eced4f-bc78-4dbc-b7ef-e49165ff1ae3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.717147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eced4f-bc78-4dbc-b7ef-e49165ff1ae3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.725063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35ce36-2cfd-4061-b19c-484b1ce4b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.727181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ce36-2cfd-4061-b19c-484b1ce4b465 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.732235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ce36-2cfd-4061-b19c-484b1ce4b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.732649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d802a-6e4c-40ed-b5fd-a91fd2772ce8 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.733691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35ce36-2cfd-4061-b19c-484b1ce4b465 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.736924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35ce36-2cfd-4061-b19c-484b1ce4b465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.738750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35ce36-2cfd-4061-b19c-484b1ce4b465 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.743932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.746398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.746398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.746650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.747856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:49.749556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:49.771650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 895/1775] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:49.771650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251805c1-704f-43ef-95f0-d103f723639d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.772535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251805c1-704f-43ef-95f0-d103f723639d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.772535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251805c1-704f-43ef-95f0-d103f723639d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:49.781576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 881/1776] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:49.782715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:49.787645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:49.820184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-251805c1-704f-43ef-95f0-d103f723639d None None] MFA Rules not processed for user `e1c621a345b748be9c162dc3bb343240`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:49.821410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-251805c1-704f-43ef-95f0-d103f723639d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:49.912011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:49.949432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42923d6-5abb-4d0c-8335-a8ec1cc7c56e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:49.963747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:49.964753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:49.966767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:49.967094 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.023477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 896/1777] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:49 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:50.024348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251805c1-704f-43ef-95f0-d103f723639d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.053537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251805c1-704f-43ef-95f0-d103f723639d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:50.064661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:50.065591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.066341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.066459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] PATH_INFO: `/v3/projects/63cc36b373c14b25a077e524ea7663e7/users/971ddf7faa704fc290e1b45454730a95/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.101372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.102001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cc36b373c14b25a077e524ea7663e7, user_id=971ddf7faa704fc290e1b45454730a95, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.103405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.105886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.125081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 882/1778] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:50.126025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.130334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 897/1779] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:50 2022] PUT /identity/v3/projects/63cc36b373c14b25a077e524ea7663e7/users/971ddf7faa704fc290e1b45454730a95/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:50.134901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.139233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb9ccb9-dc0e-438c-b8c2-f6f4be76d9af service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:50.240138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c1d113-12da-417b-9bd6-65b3a5ea5f3e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:50.247404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:50.248179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.248566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.248920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.265990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:50.267773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.268146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.268527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] PATH_INFO: `/v3/projects/504e06b411f24e3aa6a77c58abce066f/users/b0d6e2db8f5e45988d1ba62d869bb50d/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.276025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=504e06b411f24e3aa6a77c58abce066f, user_id=b0d6e2db8f5e45988d1ba62d869bb50d, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.279905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.303293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 883/1780] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:50 2022] PUT /identity/v3/projects/504e06b411f24e3aa6a77c58abce066f/users/b0d6e2db8f5e45988d1ba62d869bb50d/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:50.305947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.323551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:50.372208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.373820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.397779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 898/1781] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:50.399539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.402297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:50.532923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7a39-2354-4dbc-806f-7a1c8c7f5927 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:50.546576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a89172-9e05-41ae-b357-dedbbc8393d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:50.547744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89172-9e05-41ae-b357-dedbbc8393d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.549876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89172-9e05-41ae-b357-dedbbc8393d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.550893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a89172-9e05-41ae-b357-dedbbc8393d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.553167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a89172-9e05-41ae-b357-dedbbc8393d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.558378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a89172-9e05-41ae-b357-dedbbc8393d2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.597746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 884/1782] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:51:50.597946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfca7ca-188b-42c1-9e16-d2d8d7ec130a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.598129 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfca7ca-188b-42c1-9e16-d2d8d7ec130a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.598426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfca7ca-188b-42c1-9e16-d2d8d7ec130a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.641970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea43453-c711-4174-87a8-6d9a3b8bf402 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:50.669275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0bfca7ca-188b-42c1-9e16-d2d8d7ec130a None None] MFA Rules not processed for user `b0d6e2db8f5e45988d1ba62d869bb50d`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:50.672370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0bfca7ca-188b-42c1-9e16-d2d8d7ec130a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:50.685542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:50.756907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:50.757774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.758162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.758677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.767072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 885/1783] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:50 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:50.768535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572cf43-ea6c-407c-8d0f-a2a8c4356848 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.768827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572cf43-ea6c-407c-8d0f-a2a8c4356848 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.769112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e572cf43-ea6c-407c-8d0f-a2a8c4356848 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.770746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 886/1784] 10.222.0.20 () {54 vars in 960 bytes} [Thu Jun 30 12:51:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:51:50.772119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572cf43-ea6c-407c-8d0f-a2a8c4356848 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.773911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e572cf43-ea6c-407c-8d0f-a2a8c4356848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:50.842437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.844223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.854582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 899/1785] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:50.855423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.867834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af9b3b-4e9f-4040-8224-de0cd1bd766b service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:50.873583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e572cf43-ea6c-407c-8d0f-a2a8c4356848 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:50.874227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:50.875175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.875685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.875976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] PATH_INFO: `/v3/projects/63cc36b373c14b25a077e524ea7663e7/users/971ddf7faa704fc290e1b45454730a95/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.878191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=63cc36b373c14b25a077e524ea7663e7, user_id=971ddf7faa704fc290e1b45454730a95, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.881102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.883248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:50.884677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:50.885199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:50.885716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:50.890815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:50.900613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 900/1786] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:51:50 2022] PUT /identity/v3/projects/63cc36b373c14b25a077e524ea7663e7/users/971ddf7faa704fc290e1b45454730a95/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:50.900613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:50.909192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:50.911295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:50.913321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:50.926706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 887/1787] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:50.927843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:51.038580 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228e6589-287a-4ba8-a7a6-f40933e5549d service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:51.131955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3502e63-1251-4937-ba84-8f33fb51dc3d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:51.136589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06968b1-f8ac-4770-b40e-dcea9155f3b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:51.138208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06968b1-f8ac-4770-b40e-dcea9155f3b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:51.138687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06968b1-f8ac-4770-b40e-dcea9155f3b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:51.139088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06968b1-f8ac-4770-b40e-dcea9155f3b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:51.160416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24643da2-7bfa-42c2-bfc8-63b8fe9ae1be service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:51.161121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643da2-7bfa-42c2-bfc8-63b8fe9ae1be service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:51.161644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643da2-7bfa-42c2-bfc8-63b8fe9ae1be service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:51.161931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24643da2-7bfa-42c2-bfc8-63b8fe9ae1be service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:51.173909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:51.251152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06968b1-f8ac-4770-b40e-dcea9155f3b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:51.255550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06968b1-f8ac-4770-b40e-dcea9155f3b4 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:51.292872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 901/1788] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:51.297860 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd39ec-2407-476a-95f7-26d2c9c237d7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:51.298645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd39ec-2407-476a-95f7-26d2c9c237d7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:51.299705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd39ec-2407-476a-95f7-26d2c9c237d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:51.314635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24643da2-7bfa-42c2-bfc8-63b8fe9ae1be service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:51.316229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24643da2-7bfa-42c2-bfc8-63b8fe9ae1be service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:51.327125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-abbd39ec-2407-476a-95f7-26d2c9c237d7 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:51.329012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-abbd39ec-2407-476a-95f7-26d2c9c237d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:51.340539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 888/1789] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:51.344952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbcfb0-64b8-49d8-b68f-a8a0aa5a0f35 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:51.346398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbcfb0-64b8-49d8-b68f-a8a0aa5a0f35 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:51.346969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbcfb0-64b8-49d8-b68f-a8a0aa5a0f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:51.430555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c6bbcfb0-64b8-49d8-b68f-a8a0aa5a0f35 None None] MFA Rules not processed for user `971ddf7faa704fc290e1b45454730a95`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:51.432345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c6bbcfb0-64b8-49d8-b68f-a8a0aa5a0f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:51.541484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 902/1790] 10.222.0.20 () {58 vars in 1057 bytes} [Thu Jun 30 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:51.542666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd39ec-2407-476a-95f7-26d2c9c237d7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:51.566325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd39ec-2407-476a-95f7-26d2c9c237d7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:51.579408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:51.579922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:51.581199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:51.582969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:51.646053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 889/1791] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:51.647126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbcfb0-64b8-49d8-b68f-a8a0aa5a0f35 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:51.694265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbcfb0-64b8-49d8-b68f-a8a0aa5a0f35 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:51.719658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:51.720610 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:51.721050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:51.722658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:51.743152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:51.749067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:51.751309 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:51.784901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:51.784998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:51.791293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 890/1792] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:51.795004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:51.820537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 903/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:51.833604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3645c56b-5edb-4dc7-b6d5-2dbb081e8867 service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:51.845458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:51.855141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:51.856261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:51.862566 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:52.026930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:52.028755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:52.041716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 891/1794] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:51 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:52.082360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:52.096906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee850f4-2717-4e5a-a6ff-46e959c50e61 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:52.108468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:52.109406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:52.109640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:52.109924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:52.258220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:52.259698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:52.279120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 904/1795] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:52 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:52.561641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:52.583989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce7f909-6e49-42b0-b3d7-97d7578c9e56 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:52.595974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:52.597701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:52.597994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:52.598283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:52.613676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:52.710559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:52.713040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:52.729627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 892/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:52 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:53.392311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:53.691642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae24609-2bcb-4377-9348-7507f4010869 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:53.704418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:53.708042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:53.709416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:53.710001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:53.710982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] PATH_INFO: `/v3/users/cfe4b448fae64387a1b373af40aeaf2b` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:53.713307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfe4b448fae64387a1b373af40aeaf2b)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:53.717417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:53.738093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4d2c9-9a7d-438f-854b-c15e33d94287 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:53.751753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:53.752691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:53.752994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:53.753274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] PATH_INFO: `/v3/users/4dfb6450ccef41b1b121b46340114fa6` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:53.757306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dfb6450ccef41b1b121b46340114fa6)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:53.762854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:53.810719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfe4b448fae64387a1b373af40aeaf2b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.820706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfe4b448fae64387a1b373af40aeaf2b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.838325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfe4b448fae64387a1b373af40aeaf2b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.839556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfe4b448fae64387a1b373af40aeaf2b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.853892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1befb892-335d-4bf3-9372-1de94b8a953b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfe4b448fae64387a1b373af40aeaf2b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.862774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 905/1797] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:53 2022] DELETE /identity/v3/users/cfe4b448fae64387a1b373af40aeaf2b => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:53.866322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dfb6450ccef41b1b121b46340114fa6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.870941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:53.870941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:53.870941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:53.894292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dfb6450ccef41b1b121b46340114fa6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.895301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dfb6450ccef41b1b121b46340114fa6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.897792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dfb6450ccef41b1b121b46340114fa6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.901174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:53.905925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:53.913800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:53.929013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fd1f697e-33f4-4bb1-8789-575b3bb409a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dfb6450ccef41b1b121b46340114fa6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:53.950591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 893/1798] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:53 2022] DELETE /identity/v3/users/4dfb6450ccef41b1b121b46340114fa6 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:53.957108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:53.958529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:53.959054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:53.998983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:54.001466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:54.049538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 906/1799] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:51:54.067656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:54.070054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:54.129120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 894/1800] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:54.130107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:54.131483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:54.151913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:54.153428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d70b92e-b3f3-4462-936f-14098f824839 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:54.193267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e85a0-a2f0-4828-b8a4-168681d996ec None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:54.197543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b5ab5e-db19-4e24-976b-a02e5866755d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:54.198393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ab5e-db19-4e24-976b-a02e5866755d service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:54.198668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ab5e-db19-4e24-976b-a02e5866755d service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:54.198978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b5ab5e-db19-4e24-976b-a02e5866755d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:54.202294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-16b5ab5e-db19-4e24-976b-a02e5866755d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:54.207822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:54.208513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:54.208803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:54.209084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:54.219460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:54.220952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:54.232461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 907/1801] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:51:54.233704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:54.247804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d2f3d-24c0-4244-b3ae-760f6944550e service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:54.252693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:54.254490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:54.254934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:54.255517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:54.274387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:54.301702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5ab5e-db19-4e24-976b-a02e5866755d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:54.303086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:54.305243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b5ab5e-db19-4e24-976b-a02e5866755d service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:54.320256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 895/1802] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:54.328544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 908/1803] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:54.665072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:54.665072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:54.665470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:54.707670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:54.708958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:54.852870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 896/1804] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:51:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:55.116374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:55.117971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:55.241515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:55.260760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ecce99-66b6-42f4-a184-0c4c104a0a7d service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:55.269164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:55.270282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:55.270954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:55.271328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:55.283196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:55.285053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:55.295514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 909/1805] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:51:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:51:55.763444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:55.765307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:55.823136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a13b2aa-24a0-4d15-b840-2a5e16d644e8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:55.835573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:55.839708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:55.840670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:55.841379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] PATH_INFO: `/v3/projects/660b5d4634f64a548b54c7629a5146d4` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:55.845475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=660b5d4634f64a548b54c7629a5146d4)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:55.852606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:56.036487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '660b5d4634f64a548b54c7629a5146d4', 'request_id': 'req-370ac6bb-5c33-48a7-b124-088f7ff9e345'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.081978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '660b5d4634f64a548b54c7629a5146d4', 'request_id': 'req-370ac6bb-5c33-48a7-b124-088f7ff9e345'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.115567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '660b5d4634f64a548b54c7629a5146d4', 'request_id': 'req-370ac6bb-5c33-48a7-b124-088f7ff9e345'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.128820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:56.143049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] The token cache is being invalidate because project 660b5d4634f64a548b54c7629a5146d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:56.143877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.144787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-370ac6bb-5c33-48a7-b124-088f7ff9e345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.149904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 897/1806] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:55 2022] DELETE /identity/v3/projects/660b5d4634f64a548b54c7629a5146d4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:56.155041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:56.191335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7c81de-3519-4a0c-8869-3b75e50f682e service swift] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:56.382358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:56.383409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:56.384424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:56.400755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:56.402149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:56.403014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:56.404431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] PATH_INFO: `/v3/users/b0d6e2db8f5e45988d1ba62d869bb50d` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:56.407365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0d6e2db8f5e45988d1ba62d869bb50d)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:56.414788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:56.475725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] MFA Rules not processed for user `b35298e764904e9884012cafea48a794`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:56.478674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:56.535392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0d6e2db8f5e45988d1ba62d869bb50d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.553006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0d6e2db8f5e45988d1ba62d869bb50d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.582105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0d6e2db8f5e45988d1ba62d869bb50d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.583872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0d6e2db8f5e45988d1ba62d869bb50d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.609835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0d6e2db8f5e45988d1ba62d869bb50d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:56.630576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 910/1807] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:56 2022] DELETE /identity/v3/users/b0d6e2db8f5e45988d1ba62d869bb50d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:56.692774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 898/1808] 10.222.0.67 () {58 vars in 1015 bytes} [Thu Jun 30 12:51:56 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:56.785575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:56.790549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:56.959733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:56.961749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:57.006955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb60584f-d15a-4ce0-a352-d0e73dabd913 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:57.056265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68bc6d7-cf87-459c-9c10-2a55cd0acc11 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:57.082475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:57.083180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:57.083619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:57.083904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:57.109505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:57.111009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:57.135613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 911/1809] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:57.201036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:57.202494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:57.202981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:57.203336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] PATH_INFO: `/v3/projects/86eed8aa8bea49c19bdec2e9ff6aaf46` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:57.205349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86eed8aa8bea49c19bdec2e9ff6aaf46)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:57.207377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:57.344536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86eed8aa8bea49c19bdec2e9ff6aaf46', 'request_id': 'req-84ced5a4-4886-4c53-b475-7263c3239da0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.359840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86eed8aa8bea49c19bdec2e9ff6aaf46', 'request_id': 'req-84ced5a4-4886-4c53-b475-7263c3239da0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.374003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86eed8aa8bea49c19bdec2e9ff6aaf46', 'request_id': 'req-84ced5a4-4886-4c53-b475-7263c3239da0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.411853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] The token cache is being invalidate because project 86eed8aa8bea49c19bdec2e9ff6aaf46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:57.412337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.413288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.426025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:57.428718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 899/1810] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:56 2022] DELETE /identity/v3/projects/86eed8aa8bea49c19bdec2e9ff6aaf46 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:57.450350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea2ca4-0a5d-41ec-b3e7-4bec4ecfdb10 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:57.455376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:57.597490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:57.599880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:57.600152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:57.601110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] PATH_INFO: `/v3/users/e1c621a345b748be9c162dc3bb343240` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:57.604908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1c621a345b748be9c162dc3bb343240)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:57.605952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:57.751613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1c621a345b748be9c162dc3bb343240'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.768771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1c621a345b748be9c162dc3bb343240'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.813200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1c621a345b748be9c162dc3bb343240'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.814025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1c621a345b748be9c162dc3bb343240'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.828177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-dc7ecead-2433-45c4-ba73-c8933464f51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1c621a345b748be9c162dc3bb343240'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:57.846282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 912/1811] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:57 2022] DELETE /identity/v3/users/e1c621a345b748be9c162dc3bb343240 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:58.605856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:58.607415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:58.639547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ced5a4-4886-4c53-b475-7263c3239da0 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:58.716104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:58.781227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:58.782330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:58.782686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:58.783041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] PATH_INFO: `/v3/users/88bd2047df7c410aa5c12c37c81b0278` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:58.784461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88bd2047df7c410aa5c12c37c81b0278)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:58.787544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:58.913888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88bd2047df7c410aa5c12c37c81b0278'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:58.935715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88bd2047df7c410aa5c12c37c81b0278'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:58.937784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88bd2047df7c410aa5c12c37c81b0278'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:58.938919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88bd2047df7c410aa5c12c37c81b0278'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:58.967123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88bd2047df7c410aa5c12c37c81b0278'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.007017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 900/1812] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:58 2022] DELETE /identity/v3/users/88bd2047df7c410aa5c12c37c81b0278 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:59.007254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:59.007748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:59.007748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:59.045352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:59.046675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:59.218234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 913/1813] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:51:59.238515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:59.239865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:59.271781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:59.275216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:59.297879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9035d102-fb5b-411b-8867-d74bee8a3ef9 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:59.313662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:59.314540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:59.315078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:59.315371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] PATH_INFO: `/v3/projects/504e06b411f24e3aa6a77c58abce066f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:59.317671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=504e06b411f24e3aa6a77c58abce066f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:59.319653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:59.469696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:59.494326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '504e06b411f24e3aa6a77c58abce066f', 'request_id': 'req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.518302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '504e06b411f24e3aa6a77c58abce066f', 'request_id': 'req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.556732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '504e06b411f24e3aa6a77c58abce066f', 'request_id': 'req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.587703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] The token cache is being invalidate because project 504e06b411f24e3aa6a77c58abce066f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:51:59.588374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.590377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.592275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff6fe3-4499-4d70-b036-e539ffd1005a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:59.597227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 901/1814] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:59 2022] DELETE /identity/v3/projects/504e06b411f24e3aa6a77c58abce066f => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:51:59.598202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:59.600735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:59.721344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:51:59.743381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aeb386-7052-4467-b0af-64db77422e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:59.744330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb386-7052-4467-b0af-64db77422e5c service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:59.744739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb386-7052-4467-b0af-64db77422e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:59.745127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aeb386-7052-4467-b0af-64db77422e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:59.750931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f3aeb386-7052-4467-b0af-64db77422e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:59.799781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ece541a-d17f-45c4-bdf9-ba691fa6ed75 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:59.800797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeb386-7052-4467-b0af-64db77422e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:59.802557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aeb386-7052-4467-b0af-64db77422e5c service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:59.815568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:59.816550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:59.819133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:59.819441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] PATH_INFO: `/v3/users/ef23ed0ac41f4153aa27bc02e5637f28` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:59.826181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef23ed0ac41f4153aa27bc02e5637f28)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:59.828721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 914/1815] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:51:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 561 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:51:59.829796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:59.833525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:59.833982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:59.834370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:59.877225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:51:59.879059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:59.905853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 915/1816] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:51:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:51:59.915678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:51:59.917622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:51:59.961396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86884ad1-5d66-4590-98ad-5cdf8a1ca64a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:51:59.970654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef23ed0ac41f4153aa27bc02e5637f28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.973195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:51:59.975437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:51:59.979704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:51:59.980794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] PATH_INFO: `/v3/projects/85bbd397581e431a84ff0a2a757d2db0` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:51:59.985582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85bbd397581e431a84ff0a2a757d2db0)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:51:59.988107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:51:59.990165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef23ed0ac41f4153aa27bc02e5637f28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.990842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef23ed0ac41f4153aa27bc02e5637f28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:51:59.991593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef23ed0ac41f4153aa27bc02e5637f28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:00.017220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1eea002-f1e6-4771-89a6-3b13c2adedaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef23ed0ac41f4153aa27bc02e5637f28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:00.060907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 902/1817] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:51:59 2022] DELETE /identity/v3/users/ef23ed0ac41f4153aa27bc02e5637f28 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:00.060907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8216-1853-4378-8084-f7ce9568f084 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.060907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8216-1853-4378-8084-f7ce9568f084 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.060907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5c8216-1853-4378-8084-f7ce9568f084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.119556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7f5c8216-1853-4378-8084-f7ce9568f084 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:00.121562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7f5c8216-1853-4378-8084-f7ce9568f084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:00.181411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85bbd397581e431a84ff0a2a757d2db0', 'request_id': 'req-df8a0496-1dd1-4721-a5e3-1cecdb268b74'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:00.219810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85bbd397581e431a84ff0a2a757d2db0', 'request_id': 'req-df8a0496-1dd1-4721-a5e3-1cecdb268b74'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:00.242159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85bbd397581e431a84ff0a2a757d2db0', 'request_id': 'req-df8a0496-1dd1-4721-a5e3-1cecdb268b74'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:00.267728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 903/1818] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:00.269116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132edb4-249b-40d8-a769-303239bd1446 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.269415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132edb4-249b-40d8-a769-303239bd1446 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.269702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132edb4-249b-40d8-a769-303239bd1446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.270293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] The token cache is being invalidate because project 85bbd397581e431a84ff0a2a757d2db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:00.271119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:00.272026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-df8a0496-1dd1-4721-a5e3-1cecdb268b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:00.274264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 916/1819] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:51:59 2022] DELETE /identity/v3/projects/85bbd397581e431a84ff0a2a757d2db0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:00.276044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48b07-ce0f-486d-b988-5163ad72ca1d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.287341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48b07-ce0f-486d-b988-5163ad72ca1d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.288154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded48b07-ce0f-486d-b988-5163ad72ca1d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.291029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 917/1820] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:52:00 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:52:00.292328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48b07-ce0f-486d-b988-5163ad72ca1d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:00.295206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ded48b07-ce0f-486d-b988-5163ad72ca1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:00.312656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3132edb4-249b-40d8-a769-303239bd1446 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:00.313966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3132edb4-249b-40d8-a769-303239bd1446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:00.441401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded48b07-ce0f-486d-b988-5163ad72ca1d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:00.452751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc0f8b0-2f43-49c3-a13c-4784a90e5b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:00.454962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:00.455419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f8b0-2f43-49c3-a13c-4784a90e5b99 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.456055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f8b0-2f43-49c3-a13c-4784a90e5b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.456055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc0f8b0-2f43-49c3-a13c-4784a90e5b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.457253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f8b0-2f43-49c3-a13c-4784a90e5b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:00.458877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f8b0-2f43-49c3-a13c-4784a90e5b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:00.462734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc0f8b0-2f43-49c3-a13c-4784a90e5b99 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:00.475149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:00.498265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 904/1821] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:00.502301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4583c-1545-4045-9bcf-414c6792764f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.504711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4583c-1545-4045-9bcf-414c6792764f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.506281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a4583c-1545-4045-9bcf-414c6792764f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.511394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 918/1822] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:00.515852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7faf-fbdf-482a-a624-0834dbbec64c None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.518172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7faf-fbdf-482a-a624-0834dbbec64c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.518474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbe7faf-fbdf-482a-a624-0834dbbec64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.572216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9bbe7faf-fbdf-482a-a624-0834dbbec64c None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:00.575435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9bbe7faf-fbdf-482a-a624-0834dbbec64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:00.581584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d8a4583c-1545-4045-9bcf-414c6792764f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:00.582893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d8a4583c-1545-4045-9bcf-414c6792764f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:00.609716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 905/1823] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:00.609716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4583c-1545-4045-9bcf-414c6792764f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:00.637207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a4583c-1545-4045-9bcf-414c6792764f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:00.651059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:00.653587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.654798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.655197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.656306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:00.661066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:00.747295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 906/1824] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:00 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:00.747295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:00.751675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:00.780438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 919/1825] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:00.785450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ca0d0-8e32-4684-ad8f-ea1f7189f43b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.786565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ca0d0-8e32-4684-ad8f-ea1f7189f43b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.787790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5ca0d0-8e32-4684-ad8f-ea1f7189f43b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:00.841817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-8d5ca0d0-8e32-4684-ad8f-ea1f7189f43b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:00.846368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8d5ca0d0-8e32-4684-ad8f-ea1f7189f43b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:00.920448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91960f9-c243-4e6b-b8e6-b5dacbbb476f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:00.934100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:00.935174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:00.935802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:00.935802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.010754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 920/1826] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:01.012970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ca0d0-8e32-4684-ad8f-ea1f7189f43b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.035533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5ca0d0-8e32-4684-ad8f-ea1f7189f43b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.079331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.081351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.081726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.082019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.084432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.085175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.086751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.097696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.101439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 907/1827] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:01.102424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.117971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c5a661-b597-4b25-b254-a1ce72c7dd93 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.127109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.127889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.129096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.129689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.130863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:01.132162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.135890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.172728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 908/1828] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:01.174078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.184681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:01.188377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 921/1829] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:01 2022] POST /identity/v3/users => generated 284 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:01.190593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.217540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655d566-dc86-471e-a42d-165afbffef63 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.233496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.235538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.235845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.236130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.240687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.248350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.332230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:01.333797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 922/1830] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:01 2022] POST /identity/v3/projects => generated 393 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:01.338886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.347036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1d9e7-7777-4665-b159-fa617ebd06b7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.556963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.557780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.557935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.558270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.568783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.570828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.585070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 909/1831] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:01 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:01.586221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.594633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:01.627258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8f248-3279-4f77-b263-5feb8dba9eea admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.632340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.633309 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.633801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.634615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.635368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.639405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.695600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 923/1832] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:01.704179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.747658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b3d475-1401-46dc-9f93-918652b8d5d4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.766445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.768357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.770877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.771528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.775068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.782162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.814077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6c3aa9-c616-48b7-bf6f-53078d0fa131 service nova] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.821487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 924/1833] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:01.823420 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.828357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.829860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.832044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.832534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.834777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.837457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.848438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fa7d08-6f17-45cf-bd86-7838c9d20537 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:01.859328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:01.861384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:01.862899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:01.863068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] PATH_INFO: `/v3/projects/779f7b82a7af46dd9ba1e5d826b327ac/users/9481e197a023447f9b3a48c56b2e89ed/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:01.918467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 910/1834] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:01 2022] POST /identity/v3/users => generated 297 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:01.919159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:01.926994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:01.934603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=779f7b82a7af46dd9ba1e5d826b327ac, user_id=9481e197a023447f9b3a48c56b2e89ed, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:01.967309 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:01.983154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f634e3f-3932-4aef-985f-df4d37b2cb25 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:02.007899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 925/1835] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:01 2022] PUT /identity/v3/projects/779f7b82a7af46dd9ba1e5d826b327ac/users/9481e197a023447f9b3a48c56b2e89ed/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:02.008075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:02.008075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:02.008075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:02.009242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:02.009334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] PATH_INFO: `/v3/projects/ea2a6e5c3b6a432aa81505ac1e880e24` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:02.009334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea2a6e5c3b6a432aa81505ac1e880e24)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:02.009334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:02.198590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea2a6e5c3b6a432aa81505ac1e880e24', 'request_id': 'req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.228493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea2a6e5c3b6a432aa81505ac1e880e24', 'request_id': 'req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.252434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fe577a-1d4b-4a54-9a8a-21dfb07be9e6 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:02.262261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea2a6e5c3b6a432aa81505ac1e880e24', 'request_id': 'req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.363593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:02.364601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:02.365550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:02.365830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:02.366667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:02.369265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] The token cache is being invalidate because project ea2a6e5c3b6a432aa81505ac1e880e24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:02.369589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.370845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:02.379056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e595e41-7615-4ce9-bbd8-d8c27ca1cd01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.385437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 911/1836] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:01 2022] DELETE /identity/v3/projects/ea2a6e5c3b6a432aa81505ac1e880e24 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:02.396714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:02.397023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:02.405008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 926/1837] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:02.408349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:02.408481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:02.411993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:02.446905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:02.467416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f85cd-a4fa-42d3-81d6-b89d5c07ad41 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:02.507625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] MFA Rules not processed for user `9481e197a023447f9b3a48c56b2e89ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:02.512141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:02.513856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:02.514364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:02.514841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] PATH_INFO: `/v3/users/1f55865845384ef3826de6f357476c0b` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:02.516161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:02.516947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f55865845384ef3826de6f357476c0b)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:02.519240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:02.635301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f55865845384ef3826de6f357476c0b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.638528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:02.677908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f55865845384ef3826de6f357476c0b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.685421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 912/1838] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:02 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:02.688314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:02.697858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:02.728768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1255d-c836-4c78-90b3-08bbb6bca6c4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:02.734181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f55865845384ef3826de6f357476c0b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.735386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f55865845384ef3826de6f357476c0b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.742508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6f51e-726e-4467-82b0-38d3ef7f7c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:02.744589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6f51e-726e-4467-82b0-38d3ef7f7c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:02.745093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6f51e-726e-4467-82b0-38d3ef7f7c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:02.745386 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6f51e-726e-4467-82b0-38d3ef7f7c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:02.746253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6f51e-726e-4467-82b0-38d3ef7f7c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:02.763810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6f51e-726e-4467-82b0-38d3ef7f7c8c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:02.770359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f55865845384ef3826de6f357476c0b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:02.789072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 927/1839] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:02 2022] DELETE /identity/v3/users/1f55865845384ef3826de6f357476c0b => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:02.794138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:02.799853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:02.823196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 913/1840] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:02.826474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637795d-f041-4519-857c-c16e57427dca None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:02.826772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637795d-f041-4519-857c-c16e57427dca None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:02.827062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c637795d-f041-4519-857c-c16e57427dca None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:02.832523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 914/1841] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:52:02 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:52:02.833624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637795d-f041-4519-857c-c16e57427dca None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:02.840942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c637795d-f041-4519-857c-c16e57427dca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:02.972337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643bd69b-ee9b-40e8-bef3-9ee2aaf14301 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:02.990093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:02.992235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:02.992731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:02.994345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:02.995323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:03.001873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c637795d-f041-4519-857c-c16e57427dca None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:03.002877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:03.019854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dabe29-749a-4541-b39a-46874a85d243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:03.021918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dabe29-749a-4541-b39a-46874a85d243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.022288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dabe29-749a-4541-b39a-46874a85d243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.022451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dabe29-749a-4541-b39a-46874a85d243 admin admin] PATH_INFO: `/v3/projects/db66e45768e04aad9d57e2f3767b24ef/users/28ac9afa5037473aaef658f9ffddf86c/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.046434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dabe29-749a-4541-b39a-46874a85d243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db66e45768e04aad9d57e2f3767b24ef, user_id=28ac9afa5037473aaef658f9ffddf86c, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:03.057083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dabe29-749a-4541-b39a-46874a85d243 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:03.099762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 928/1842] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:02 2022] POST /identity/v3/projects => generated 367 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:03.101284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:03.103337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 915/1843] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:02 2022] PUT /identity/v3/projects/db66e45768e04aad9d57e2f3767b24ef/users/28ac9afa5037473aaef658f9ffddf86c/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:03.120599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3887b3-c3ee-4cbc-b3f2-7fb5c4625d38 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.121836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3887b3-c3ee-4cbc-b3f2-7fb5c4625d38 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.123578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3887b3-c3ee-4cbc-b3f2-7fb5c4625d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.187820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ed3887b3-c3ee-4cbc-b3f2-7fb5c4625d38 None None] MFA Rules not processed for user `28ac9afa5037473aaef658f9ffddf86c`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:03.192137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ed3887b3-c3ee-4cbc-b3f2-7fb5c4625d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:03.236304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb49dbe9-e4dd-441c-a76a-88bcc9fcff43 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:03.244156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239cff4-2fed-4559-8b1a-d3b77e3c03ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:03.245032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239cff4-2fed-4559-8b1a-d3b77e3c03ba admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.246484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239cff4-2fed-4559-8b1a-d3b77e3c03ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.246917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239cff4-2fed-4559-8b1a-d3b77e3c03ba admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.247897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239cff4-2fed-4559-8b1a-d3b77e3c03ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:03.263025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239cff4-2fed-4559-8b1a-d3b77e3c03ba admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:03.302581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 929/1844] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:03 2022] POST /identity/v3/users => generated 290 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:03.303865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8a193-5c0c-479d-8b20-a6e8862524c1 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.304167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8a193-5c0c-479d-8b20-a6e8862524c1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.313033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8a193-5c0c-479d-8b20-a6e8862524c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.347328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:03.356089 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6cc8a193-5c0c-479d-8b20-a6e8862524c1 None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:03.361113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6cc8a193-5c0c-479d-8b20-a6e8862524c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:03.380901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 916/1845] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:03.382229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3887b3-c3ee-4cbc-b3f2-7fb5c4625d38 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:03.419545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3887b3-c3ee-4cbc-b3f2-7fb5c4625d38 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:03.435666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:03.436444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.436743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.437025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.437837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:03.440326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:03.461449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 917/1846] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:03.461449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:03.475988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4516995a-80bf-4ef4-a270-64658e925b9c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:03.481762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:03.482344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.482645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.482945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.483710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:03.491927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:03.516688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:03.547338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 918/1847] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:03 2022] POST /identity/v3/projects => generated 393 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:03.553142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:03.642721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 930/1848] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:52:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:03.643904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8a193-5c0c-479d-8b20-a6e8862524c1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:03.663547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8a193-5c0c-479d-8b20-a6e8862524c1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:03.765898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac29a32b-6219-4f71-9c3f-6f9eb771e9bb admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:03.785836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:03.788603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.788936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.789230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] PATH_INFO: `/v3/projects/8dd35c89270f49ab918de81bf6e18f34/users/1934e9a1b6c14e5ba12fd7a117d582d4/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.843464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd35c89270f49ab918de81bf6e18f34, user_id=1934e9a1b6c14e5ba12fd7a117d582d4, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:03.846478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:03.868069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:03.874008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:03.874571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:03.876076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:03.877611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:03.885021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 919/1849] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:03 2022] PUT /identity/v3/projects/8dd35c89270f49ab918de81bf6e18f34/users/1934e9a1b6c14e5ba12fd7a117d582d4/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:03.885021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:03.886052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:03.887471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:03.934485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 931/1850] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:03 2022] POST /identity/v3/users => generated 303 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:03.935740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:03.956020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973b935b-b184-442a-bead-a0a5cb7d062e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.094526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a36b6-a17a-4b76-a0cd-f09bc537b31a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.111030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.111899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.112197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.112687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.115063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:04.118865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:04.118995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.119553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.119840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.120186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.143009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 932/1851] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:03 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:04.143950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:04.149266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:04.151677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:04.155813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024e339-67cb-464b-90fd-76828bc07878 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.161199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.161827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.162229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.162490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.163247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:04.165291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:04.176345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 920/1852] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:04.180485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:04.193849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 933/1853] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:04.194274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:04.210111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74f451d-10bf-4088-97f8-3ad17cd5c402 service nova] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.212952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa641d-bce9-498a-b175-c35fba70cb7d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.224856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.225781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.226125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.226353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] PATH_INFO: `/v3/projects/8f7f9c858d2242738cc2245a0ae81262/users/6b56181affa745e5851358746ceebd6a/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.244777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46037cac-63a7-4830-8b08-5939c20a7d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.247925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037cac-63a7-4830-8b08-5939c20a7d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.248263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037cac-63a7-4830-8b08-5939c20a7d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.248839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46037cac-63a7-4830-8b08-5939c20a7d2f admin admin] PATH_INFO: `/v3/projects/8dd35c89270f49ab918de81bf6e18f34/users/1934e9a1b6c14e5ba12fd7a117d582d4/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.254650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46037cac-63a7-4830-8b08-5939c20a7d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd35c89270f49ab918de81bf6e18f34, user_id=1934e9a1b6c14e5ba12fd7a117d582d4, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:04.262218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46037cac-63a7-4830-8b08-5939c20a7d2f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:04.293645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7f9c858d2242738cc2245a0ae81262, user_id=6b56181affa745e5851358746ceebd6a, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:04.299857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:04.304304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 921/1854] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:04 2022] PUT /identity/v3/projects/8dd35c89270f49ab918de81bf6e18f34/users/1934e9a1b6c14e5ba12fd7a117d582d4/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:04.334977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.337694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.343782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.347615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 934/1855] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:04 2022] PUT /identity/v3/projects/8f7f9c858d2242738cc2245a0ae81262/users/6b56181affa745e5851358746ceebd6a/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:04.374118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:04.450043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] MFA Rules not processed for user `1934e9a1b6c14e5ba12fd7a117d582d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:04.451404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:04.461820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:04.512705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:04.598594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685b03b6-2df4-43c8-a668-5b1937d63ec2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.604602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.606813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.607449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.607966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.609084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:04.611617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:04.629344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 935/1856] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:04.645338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:04.652694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 922/1857] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:04.659613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611144ec-3910-4f09-b4ff-fa9fa44754fd admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.661903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:04.663801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:04.674701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc803c1-0f0c-452b-b67e-dd35ae5e2483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.675757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc803c1-0f0c-452b-b67e-dd35ae5e2483 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.676033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc803c1-0f0c-452b-b67e-dd35ae5e2483 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.676314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc803c1-0f0c-452b-b67e-dd35ae5e2483 admin admin] PATH_INFO: `/v3/projects/8f7f9c858d2242738cc2245a0ae81262/users/6b56181affa745e5851358746ceebd6a/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.683883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc803c1-0f0c-452b-b67e-dd35ae5e2483 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f7f9c858d2242738cc2245a0ae81262, user_id=6b56181affa745e5851358746ceebd6a, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:04.688512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc803c1-0f0c-452b-b67e-dd35ae5e2483 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:04.732327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 936/1858] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:04 2022] PUT /identity/v3/projects/8f7f9c858d2242738cc2245a0ae81262/users/6b56181affa745e5851358746ceebd6a/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:04.737189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.737674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.737996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.783298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1be4ae-8b56-4dc7-bac0-66decf9429ec None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.783974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] MFA Rules not processed for user `6b56181affa745e5851358746ceebd6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:04.785964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:04.893090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.895426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:04.895426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:04.911034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 937/1859] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:04.916872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:04.920857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:04.925487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:04.972976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977ce427-4385-48bc-badf-cd10c302c76e None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:04.999354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:04.999957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:05.000373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:05.000646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:05.013188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:05.015141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:05.028371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 938/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:04 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:05.145687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:05.164255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4518e351-eda9-4bfb-9381-6499fa826dad service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:05.169842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:05.171403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:05.172790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:05.173832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:05.174597 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:05.175229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:05.202472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 923/1861] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:04 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:05.328600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:05.331978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:05.338444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:05.346868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:05.363092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:05.405802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 939/1862] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:05.405802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:05.405802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:05.441140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:05.557091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e61764-6f34-4ec3-8f0e-0e4d0f0ae601 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:05.581843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:05.584061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:05.585900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:05.586458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] PATH_INFO: `/v3/projects/47e2cbfc965a4d0684c4eee30fe33201` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:05.588663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=47e2cbfc965a4d0684c4eee30fe33201)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:05.593738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:05.627817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178fdb5-308d-49ab-9674-f5d2e7dcac05 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:05.641582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:05.644487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:05.644781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:05.645070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] PATH_INFO: `/v3/projects/2c5b5d1617b14cc5ba96607ca59ef43c` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:05.648212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c5b5d1617b14cc5ba96607ca59ef43c)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:05.655630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:05.747854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c5b5d1617b14cc5ba96607ca59ef43c', 'request_id': 'req-8dd96ef7-521c-4184-89e1-6af4a66344cc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.757385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47e2cbfc965a4d0684c4eee30fe33201', 'request_id': 'req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.761878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c5b5d1617b14cc5ba96607ca59ef43c', 'request_id': 'req-8dd96ef7-521c-4184-89e1-6af4a66344cc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.774452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47e2cbfc965a4d0684c4eee30fe33201', 'request_id': 'req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.778490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c5b5d1617b14cc5ba96607ca59ef43c', 'request_id': 'req-8dd96ef7-521c-4184-89e1-6af4a66344cc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.798562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] The token cache is being invalidate because project 2c5b5d1617b14cc5ba96607ca59ef43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:05.799152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.800028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.802661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 940/1863] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:05 2022] DELETE /identity/v3/projects/2c5b5d1617b14cc5ba96607ca59ef43c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:05.802879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47e2cbfc965a4d0684c4eee30fe33201', 'request_id': 'req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.808824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:05.813943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:05.833512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] The token cache is being invalidate because project 47e2cbfc965a4d0684c4eee30fe33201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:05.835427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.837968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49f61ba7-d1b2-4df7-8be7-c137e70cdf1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:05.841706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 924/1864] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:05 2022] DELETE /identity/v3/projects/47e2cbfc965a4d0684c4eee30fe33201 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:05.850405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1508d4-4fed-4387-ba29-cf0fead421d4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:05.851557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1508d4-4fed-4387-ba29-cf0fead421d4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:05.852694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1508d4-4fed-4387-ba29-cf0fead421d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:05.923644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd96ef7-521c-4184-89e1-6af4a66344cc admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:05.930670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-bc1508d4-4fed-4387-ba29-cf0fead421d4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:05.931350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:05.932017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bc1508d4-4fed-4387-ba29-cf0fead421d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:05.932530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:05.935043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:05.935043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] PATH_INFO: `/v3/users/971ddf7faa704fc290e1b45454730a95` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:05.937922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=971ddf7faa704fc290e1b45454730a95)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:05.943619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:05.951005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 925/1865] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:05.952891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e0ecd-d083-402d-bb53-1be022c7e460 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:05.953187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e0ecd-d083-402d-bb53-1be022c7e460 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:05.956032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929e0ecd-d083-402d-bb53-1be022c7e460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.008134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-929e0ecd-d083-402d-bb53-1be022c7e460 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:06.012240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-929e0ecd-d083-402d-bb53-1be022c7e460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:06.028511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971ddf7faa704fc290e1b45454730a95'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:06.030828 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:06.036430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 926/1866] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:06.042187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e0ecd-d083-402d-bb53-1be022c7e460 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:06.046248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971ddf7faa704fc290e1b45454730a95'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:06.075026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929e0ecd-d083-402d-bb53-1be022c7e460 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:06.084947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971ddf7faa704fc290e1b45454730a95'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:06.088506 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971ddf7faa704fc290e1b45454730a95'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:06.102260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:06.107232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:06.107608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:06.107923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.108788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:06.109109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:06.110822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:06.118263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971ddf7faa704fc290e1b45454730a95'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:06.128543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 927/1867] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:06.133811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:06.135944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:06.143313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 941/1868] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:05 2022] DELETE /identity/v3/users/971ddf7faa704fc290e1b45454730a95 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:06.156230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31e7eb8-1b1f-4f21-b862-e1d088080c03 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:06.239233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:06.242162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:06.242459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:06.242741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.243463 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:06.250211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:06.272121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:06.312552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 928/1869] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:06 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:06.313662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:06.331816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0831c2c-9d07-496d-bf76-84bd4794ee2d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:06.510091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:06.511216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:06.512204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:06.513327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.514220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:06.521996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:06.572585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 942/1870] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:06 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:06.573986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:06.590778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1c458-8fbf-4e4b-b510-f925076f8ef2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:06.610482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:06.611474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:06.614242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:06.614841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.617091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:06.618939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:06.668467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 929/1871] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:06.668594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:06.690680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dd52a5-2eb6-4260-9dff-d4f2f89ddf8f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:06.703645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577a8f17-a145-4587-b1c3-13b58492f6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:06.704366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8f17-a145-4587-b1c3-13b58492f6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:06.704827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8f17-a145-4587-b1c3-13b58492f6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:06.705288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577a8f17-a145-4587-b1c3-13b58492f6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.706274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a8f17-a145-4587-b1c3-13b58492f6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:06.708047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577a8f17-a145-4587-b1c3-13b58492f6d1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:06.742542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 943/1872] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:06.743906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:06.762406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2852a316-245d-4922-a602-73ae2c70bb32 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:06.778281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:06.779614 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:06.780231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:06.780875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] PATH_INFO: `/v3/projects/19f6fb1799524cda92f68c80a0022892/users/8f4fe15b2b734bdd8e2a39ac134cdda8/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.809973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f6fb1799524cda92f68c80a0022892, user_id=8f4fe15b2b734bdd8e2a39ac134cdda8, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:06.813453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:06.833235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 930/1873] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:06 2022] PUT /identity/v3/projects/19f6fb1799524cda92f68c80a0022892/users/8f4fe15b2b734bdd8e2a39ac134cdda8/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:06.845746 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:06.846042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:06.850178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:06.921201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] MFA Rules not processed for user `8f4fe15b2b734bdd8e2a39ac134cdda8`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:06.922643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:07.137945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:07.144117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 944/1874] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:07.375043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d752b6f-1e8e-4ea3-bda6-48f72c18cc65 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:07.381783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:07.384253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:07.390508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:07.392298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:07.394021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:07.394321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:07.395287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:07.401415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:07.418784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a294d-bd76-46bb-be53-8334e1eebfea None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:07.439182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:07.442283 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:07.442577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:07.442857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] PATH_INFO: `/v3/projects/63cc36b373c14b25a077e524ea7663e7` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:07.444488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63cc36b373c14b25a077e524ea7663e7)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:07.450243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:07.490821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 931/1875] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:07 2022] POST /identity/v3/projects => generated 379 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:07.495681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:07.565270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:INSERT=4,keystone:DELETE=5,keystone:SELECT=91 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:07.603974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63cc36b373c14b25a077e524ea7663e7', 'request_id': 'req-8de05536-c696-44ae-b549-59ff53e52812'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:07.646906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faa6916-1c65-4a1b-9a36-79371d819198 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:07.647563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63cc36b373c14b25a077e524ea7663e7', 'request_id': 'req-8de05536-c696-44ae-b549-59ff53e52812'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:07.675507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63cc36b373c14b25a077e524ea7663e7', 'request_id': 'req-8de05536-c696-44ae-b549-59ff53e52812'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:07.709722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] The token cache is being invalidate because project 63cc36b373c14b25a077e524ea7663e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:07.710021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:07.713356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8de05536-c696-44ae-b549-59ff53e52812 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:07.723272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 945/1876] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:07 2022] DELETE /identity/v3/projects/63cc36b373c14b25a077e524ea7663e7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:07.729359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae15e4-743f-4c69-b1d0-0d31e287be91 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:07.729579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae15e4-743f-4c69-b1d0-0d31e287be91 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:07.730937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae15e4-743f-4c69-b1d0-0d31e287be91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:07.769383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:07.780425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-caae15e4-743f-4c69-b1d0-0d31e287be91 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:07.781704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-caae15e4-743f-4c69-b1d0-0d31e287be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:07.787210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:07.787966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:07.788256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:07.788576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:07.789822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:07.793808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:07.799766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 946/1877] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:07.810097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a755-308b-409c-becb-0a120293c142 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:07.810406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a755-308b-409c-becb-0a120293c142 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:07.810696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43a755-308b-409c-becb-0a120293c142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:07.842991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 932/1878] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:07 2022] POST /identity/v3/users => generated 290 bytes in 348 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:07.846920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:07.849360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:07.866735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46d1378-4b56-42a5-9afa-1bd0634ea66f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:07.874235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:07.874949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:07.875238 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:07.875519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:07.876572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:07.878864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:07.882443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4f43a755-308b-409c-becb-0a120293c142 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:07.883848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4f43a755-308b-409c-becb-0a120293c142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:07.903248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 933/1879] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:07.907346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:07.934996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 947/1880] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:07.935319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43a755-308b-409c-becb-0a120293c142 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:07.961829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66c45-223f-4032-b27f-09928fdf011a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:07.975908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f43a755-308b-409c-becb-0a120293c142 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:07.979525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:07.980187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:07.980573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:07.980865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:07.981622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:07.983656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:07.997528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:07.999609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.000111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.004717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.005693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:08.006093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.007843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.038351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 934/1881] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:08.039726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.053744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 948/1882] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:08.058582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.072128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e2b1e-4d3e-42e7-ae39-c525a4611d6d admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.083376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d527987-d2b9-4c99-88f7-8bdfc99a3283 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.085547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.086462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.086785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.087155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] PATH_INFO: `/v3/projects/60d679860bcc4b62983488a084d066ef/users/b4a5e4fc92fe4be783c0d9ed9bb1a857/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.097376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32728f36-0208-486f-abf9-58f3d566205a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.098810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728f36-0208-486f-abf9-58f3d566205a admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.099326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728f36-0208-486f-abf9-58f3d566205a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.099908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32728f36-0208-486f-abf9-58f3d566205a admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.102784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32728f36-0208-486f-abf9-58f3d566205a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.106255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32728f36-0208-486f-abf9-58f3d566205a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.122500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60d679860bcc4b62983488a084d066ef, user_id=b4a5e4fc92fe4be783c0d9ed9bb1a857, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.125497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.148009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 935/1883] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:08 2022] PUT /identity/v3/projects/60d679860bcc4b62983488a084d066ef/users/b4a5e4fc92fe4be783c0d9ed9bb1a857/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:08.153183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 949/1884] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:08 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:08.154479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.161850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc32b0-2401-4e5b-9eb3-349529a15754 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.161850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc32b0-2401-4e5b-9eb3-349529a15754 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.161850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc32b0-2401-4e5b-9eb3-349529a15754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.197561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5bbc32b0-2401-4e5b-9eb3-349529a15754 None None] MFA Rules not processed for user `b4a5e4fc92fe4be783c0d9ed9bb1a857`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:08.199818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5bbc32b0-2401-4e5b-9eb3-349529a15754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:08.243530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147aa382-27fe-4991-a382-e9b310231fb6 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.319028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.320022 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.320456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.320990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.321634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.325099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.346578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 950/1885] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:08.349256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc32b0-2401-4e5b-9eb3-349529a15754 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.360822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 936/1886] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:08 2022] POST /identity/v3/users => generated 293 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:08.365622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.376839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc32b0-2401-4e5b-9eb3-349529a15754 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.380279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778dbff6-62d8-40b6-ac2d-db36cfec6641 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.388628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.389464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.389597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.389862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.390243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.390726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.391680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.392068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.392429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.393224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.393470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.398885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.409490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 937/1887] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:08.412333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.426990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a986eec4-d915-4858-9a59-1b6c606ca34f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.448064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.449449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.449867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.450467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.453365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.457974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.462711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 951/1888] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:08 2022] POST /identity/v3/projects => generated 379 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:08.468987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.494993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 938/1889] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:08.500332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.521370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afdd88-4375-4304-90e1-f48d692d2c2b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.535685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:08.559656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:08.599317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde240c9-9657-45e5-9be9-1dae017ea28b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.605730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.606663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.606916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.607131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.607921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.609952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.621950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadc6e3-9771-4a47-86a6-c4326765c27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.623377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadc6e3-9771-4a47-86a6-c4326765c27d admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.623733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadc6e3-9771-4a47-86a6-c4326765c27d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.627372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadc6e3-9771-4a47-86a6-c4326765c27d admin admin] PATH_INFO: `/v3/projects/32a8c01e2e3b4ce499ce95aad82222c7/users/dc4dc93b6cc74d379c02a20aedb99f4c/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.644107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadc6e3-9771-4a47-86a6-c4326765c27d admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a8c01e2e3b4ce499ce95aad82222c7, user_id=dc4dc93b6cc74d379c02a20aedb99f4c, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.646673 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 952/1890] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:08 2022] POST /identity/v3/users => generated 296 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:08.651789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.652509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baadc6e3-9771-4a47-86a6-c4326765c27d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.664508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5b251-0ddf-4e85-828f-cc1ec0f8f77e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.681355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 939/1891] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:08 2022] PUT /identity/v3/projects/32a8c01e2e3b4ce499ce95aad82222c7/users/dc4dc93b6cc74d379c02a20aedb99f4c/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:08.692345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd2b1-8946-4917-bd8e-ac6b569cc6d0 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.692811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd2b1-8946-4917-bd8e-ac6b569cc6d0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.693197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dd2b1-8946-4917-bd8e-ac6b569cc6d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.728257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f36dd2b1-8946-4917-bd8e-ac6b569cc6d0 None None] MFA Rules not processed for user `dc4dc93b6cc74d379c02a20aedb99f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:08.733643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f36dd2b1-8946-4917-bd8e-ac6b569cc6d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:08.761193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.762440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.762939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.763236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.764026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.765916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.784841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 953/1892] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:08.785595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.798875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd8c99b-e80f-4cc7-87d2-11c592529061 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.804874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.806358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.806777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.806911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] PATH_INFO: `/v3/projects/1d3f09eec5dc4f00aed0a9cc52562926/users/07c36accfa644677a1470332545cb5dc/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.833781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3f09eec5dc4f00aed0a9cc52562926, user_id=07c36accfa644677a1470332545cb5dc, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.837776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.859454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 954/1894] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:08 2022] PUT /identity/v3/projects/1d3f09eec5dc4f00aed0a9cc52562926/users/07c36accfa644677a1470332545cb5dc/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:08.859454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.859985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 940/1894] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:08.862528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dd2b1-8946-4917-bd8e-ac6b569cc6d0 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.881621 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36dd2b1-8946-4917-bd8e-ac6b569cc6d0 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.954748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.955495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.955767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.956157 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.956894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.958532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.963524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c18a7-d414-4727-89de-f18d6f3f1738 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.970514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 941/1895] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:08.971407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:08.973824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:08.977497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.978295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.978690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.979010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.979785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.982555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:08.988081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc8f07d-b1a2-4057-b3a1-1c7764b773d1 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:08.994405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:08.995293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:08.995665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:08.995980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] PATH_INFO: `/v3/users/9481e197a023447f9b3a48c56b2e89ed` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:08.997544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9481e197a023447f9b3a48c56b2e89ed)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:08.999504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.017511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:09.028455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 955/1896] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:08 2022] POST /identity/v3/projects => generated 387 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:09.029567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.060697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:09.064783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9481e197a023447f9b3a48c56b2e89ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.072675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9481e197a023447f9b3a48c56b2e89ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.073315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9481e197a023447f9b3a48c56b2e89ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.074477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9481e197a023447f9b3a48c56b2e89ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.087344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9481e197a023447f9b3a48c56b2e89ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.100601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690f867c-86de-4c05-ae07-677924adbba9 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.100784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 942/1897] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:08 2022] DELETE /identity/v3/users/9481e197a023447f9b3a48c56b2e89ed => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:09.101328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.105547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.159497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c47d46-db55-48f6-9cc4-723dc947ad41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.160408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47d46-db55-48f6-9cc4-723dc947ad41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.160708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47d46-db55-48f6-9cc4-723dc947ad41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.160990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c47d46-db55-48f6-9cc4-723dc947ad41 admin admin] PATH_INFO: `/v3/projects/1d3f09eec5dc4f00aed0a9cc52562926/users/07c36accfa644677a1470332545cb5dc/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.163041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c47d46-db55-48f6-9cc4-723dc947ad41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3f09eec5dc4f00aed0a9cc52562926, user_id=07c36accfa644677a1470332545cb5dc, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.165866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c47d46-db55-48f6-9cc4-723dc947ad41 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.175336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845323a6-8ab5-45c6-859a-217f1ee12c66 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.178002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 956/1898] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:09 2022] PUT /identity/v3/projects/1d3f09eec5dc4f00aed0a9cc52562926/users/07c36accfa644677a1470332545cb5dc/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:09.184979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23fd3f-2cb4-4982-bf87-e62f0582e129 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.185315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23fd3f-2cb4-4982-bf87-e62f0582e129 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.185733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23fd3f-2cb4-4982-bf87-e62f0582e129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.204780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-8f23fd3f-2cb4-4982-bf87-e62f0582e129 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:09.205993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8f23fd3f-2cb4-4982-bf87-e62f0582e129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.239862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87929945-b181-4d37-b62e-99a61a359d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.240531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929945-b181-4d37-b62e-99a61a359d29 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.240849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929945-b181-4d37-b62e-99a61a359d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.241127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87929945-b181-4d37-b62e-99a61a359d29 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.241829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87929945-b181-4d37-b62e-99a61a359d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.243792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87929945-b181-4d37-b62e-99a61a359d29 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.268559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 943/1899] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:09 2022] POST /identity/v3/users => generated 300 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:09.268559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26e018-e3ee-4922-aec2-0332d444d770 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.268559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26e018-e3ee-4922-aec2-0332d444d770 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.268559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be26e018-e3ee-4922-aec2-0332d444d770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.271683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 957/1900] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:09.272561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23fd3f-2cb4-4982-bf87-e62f0582e129 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.284629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23fd3f-2cb4-4982-bf87-e62f0582e129 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.289447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.290118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.290406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.290689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.291453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.293550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.297070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-be26e018-e3ee-4922-aec2-0332d444d770 None None] MFA Rules not processed for user `07c36accfa644677a1470332545cb5dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:09.298634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-be26e018-e3ee-4922-aec2-0332d444d770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.303982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 958/1901] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:09.305715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.309452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.319828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:09.374777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f230b-815a-4abf-8971-ba97c8968f4a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.378737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.379395 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.379685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.379967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.387556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 944/1902] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:09.388452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:09.388744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26e018-e3ee-4922-aec2-0332d444d770 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.391058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.392678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.400671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be26e018-e3ee-4922-aec2-0332d444d770 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.405100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 959/1903] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:09.406246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.407815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.407953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.409030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.409419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.409798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] PATH_INFO: `/v3/projects/51e4867565a2408e8837388a32188fc3/users/672b3e80583744bdb268e8f7378b5c8b/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.436456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e4867565a2408e8837388a32188fc3, user_id=672b3e80583744bdb268e8f7378b5c8b, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.439213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.467554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 945/1904] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:09 2022] PUT /identity/v3/projects/51e4867565a2408e8837388a32188fc3/users/672b3e80583744bdb268e8f7378b5c8b/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:09.469583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.493336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b027d7-466f-429c-9dd1-f9b832c678b9 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.575312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75bb2f5-67dd-4cba-8e37-eabf4644f09e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.587266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.587962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.588255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.588576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.589123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.589986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.590603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.591032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.591469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.592057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.609700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 946/1905] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:09 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:09.610788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.613943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.633062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe70b978-cc5e-466a-8d58-c22aea497b9e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.638998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.640128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.640622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.641064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] PATH_INFO: `/v3/users/d89f470823d746fd9df7c64b669f7103` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.642769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d89f470823d746fd9df7c64b669f7103)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.644910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.715504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.717781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.725960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd89f470823d746fd9df7c64b669f7103'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.728448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 960/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:09.729258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.741400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd89f470823d746fd9df7c64b669f7103'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.742330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd89f470823d746fd9df7c64b669f7103'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.743139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd89f470823d746fd9df7c64b669f7103'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.753658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73179f2-8b13-4422-91c5-86bad2903d4f service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.762925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.764996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.765377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.765513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5eaf9936-de45-4f39-acb7-bac8997e6fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd89f470823d746fd9df7c64b669f7103'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:09.765785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] PATH_INFO: `/v3/projects/51e4867565a2408e8837388a32188fc3/users/672b3e80583744bdb268e8f7378b5c8b/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.769303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51e4867565a2408e8837388a32188fc3, user_id=672b3e80583744bdb268e8f7378b5c8b, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:09.772539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:09.776077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:09.782931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 947/1907] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:09 2022] DELETE /identity/v3/users/d89f470823d746fd9df7c64b669f7103 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:09.787726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db968313-d009-4d1b-8ffb-dd8d76808d2c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.788123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db968313-d009-4d1b-8ffb-dd8d76808d2c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.788676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db968313-d009-4d1b-8ffb-dd8d76808d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.798879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 961/1908] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:09 2022] PUT /identity/v3/projects/51e4867565a2408e8837388a32188fc3/users/672b3e80583744bdb268e8f7378b5c8b/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:09.809226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:09.811332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.817033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-db968313-d009-4d1b-8ffb-dd8d76808d2c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:09.818269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-db968313-d009-4d1b-8ffb-dd8d76808d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.884516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:09.889483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde68030-89eb-4d8d-9d65-626533709104 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:09.897590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 948/1909] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:09.898937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c2177-b731-4929-b597-632f433364f7 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.899272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c2177-b731-4929-b597-632f433364f7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.899650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c2177-b731-4929-b597-632f433364f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.937748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b57c2177-b731-4929-b597-632f433364f7 None None] MFA Rules not processed for user `672b3e80583744bdb268e8f7378b5c8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:09.938973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b57c2177-b731-4929-b597-632f433364f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:09.952838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:09.953511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:09.953882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:09.954316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:09.957270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.025105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 949/1910] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:09 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:10.025105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c2177-b731-4929-b597-632f433364f7 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.025105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b57c2177-b731-4929-b597-632f433364f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.030318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:10.031876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:10.040910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57c2177-b731-4929-b597-632f433364f7 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:10.047141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:10.048196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.048626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.048796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 962/1911] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:09 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:10.048915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] PATH_INFO: `/v3/projects/779f7b82a7af46dd9ba1e5d826b327ac` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.049763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.050339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=779f7b82a7af46dd9ba1e5d826b327ac)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:10.051581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.052889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:10.140731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '779f7b82a7af46dd9ba1e5d826b327ac', 'request_id': 'req-d7bf5953-b11a-46b9-bf43-288e59963e1b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.150416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '779f7b82a7af46dd9ba1e5d826b327ac', 'request_id': 'req-d7bf5953-b11a-46b9-bf43-288e59963e1b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.155312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99788a24-5e2a-493b-b9db-91fa08b2450b service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:10.166549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '779f7b82a7af46dd9ba1e5d826b327ac', 'request_id': 'req-d7bf5953-b11a-46b9-bf43-288e59963e1b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.183646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] The token cache is being invalidate because project 779f7b82a7af46dd9ba1e5d826b327ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:10.184537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.185241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.187703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 950/1912] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:10 2022] DELETE /identity/v3/projects/779f7b82a7af46dd9ba1e5d826b327ac => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:10.188444 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.190318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.205175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:10.236055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:10.237102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.237980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.238666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.241777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.284515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bf5953-b11a-46b9-bf43-288e59963e1b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:10.295500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:10.295771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:10.296555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.297354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.297711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.300077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.343280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:10.346131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:10.357545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 963/1913] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:10.358352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.359791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.373908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b6f717-ff43-4bdd-aa38-ff367853700a service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:10.379959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:10.381072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.381589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.382215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] PATH_INFO: `/v3/users/28ac9afa5037473aaef658f9ffddf86c` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.383803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ac9afa5037473aaef658f9ffddf86c)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:10.385940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:10.386873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:10.389766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:10.408668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 951/1914] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:10.425506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.427824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.469215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0951e17f-6f82-4719-9ac1-8c48fea2a1d3 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:10.474183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ac9afa5037473aaef658f9ffddf86c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.484805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:10.488446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.489275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.489985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] PATH_INFO: `/v3/users/1934e9a1b6c14e5ba12fd7a117d582d4` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.491814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=1934e9a1b6c14e5ba12fd7a117d582d4)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:10.494692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:10.498278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ac9afa5037473aaef658f9ffddf86c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.529538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ac9afa5037473aaef658f9ffddf86c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.530343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ac9afa5037473aaef658f9ffddf86c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.546853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-aa0c1b77-ba73-49eb-8d8b-7cbd2359da0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ac9afa5037473aaef658f9ffddf86c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.563126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 964/1915] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:10 2022] DELETE /identity/v3/users/28ac9afa5037473aaef658f9ffddf86c => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:10.564230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.564679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.565032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.617907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:10.618955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1934e9a1b6c14e5ba12fd7a117d582d4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.619242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.634451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1934e9a1b6c14e5ba12fd7a117d582d4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.635077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1934e9a1b6c14e5ba12fd7a117d582d4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.637683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1934e9a1b6c14e5ba12fd7a117d582d4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.661112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1934e9a1b6c14e5ba12fd7a117d582d4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.699129 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 952/1916] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:10 2022] DELETE /identity/v3/users/1934e9a1b6c14e5ba12fd7a117d582d4 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:10.700136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.711280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.764215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 965/1917] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:10.783520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.784207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:10.789259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.835809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6e97cc-016c-4cee-a4a7-f51f7e1e87cb admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:10.844066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:10.847494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.847494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.847494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] PATH_INFO: `/v3/users/dc4dc93b6cc74d379c02a20aedb99f4c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.848268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4dc93b6cc74d379c02a20aedb99f4c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:10.851198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:10.860216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:10.896997 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715174aa-fe33-4e1b-858a-eb9a6d6aa9bd None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:10.935418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4dc93b6cc74d379c02a20aedb99f4c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.947714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4dc93b6cc74d379c02a20aedb99f4c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.950220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4dc93b6cc74d379c02a20aedb99f4c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.951334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4dc93b6cc74d379c02a20aedb99f4c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.970301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4dc93b6cc74d379c02a20aedb99f4c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:10.982218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb3758-6034-4b48-9a95-b0d9b325a9ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:10.983377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb3758-6034-4b48-9a95-b0d9b325a9ff service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:10.983793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb3758-6034-4b48-9a95-b0d9b325a9ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:10.984218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb3758-6034-4b48-9a95-b0d9b325a9ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:10.987520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-68fb3758-6034-4b48-9a95-b0d9b325a9ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:10.992764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 953/1918] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:10 2022] DELETE /identity/v3/users/dc4dc93b6cc74d379c02a20aedb99f4c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:10.992764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:10.993775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:11.007742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb3758-6034-4b48-9a95-b0d9b325a9ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:11.009232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb3758-6034-4b48-9a95-b0d9b325a9ff service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:11.027580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 966/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:11.029033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:11.029326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:11.029599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:11.059900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:11.061922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:11.083973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b08694-1753-4a3b-b584-20a21b6c670e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:11.091775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:11.095547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:11.095896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:11.096230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] PATH_INFO: `/v3/projects/dff4714a1ca34147aeb638e9d010e73c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:11.097600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff4714a1ca34147aeb638e9d010e73c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:11.099560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:11.159074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 967/1920] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:11.171321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff4714a1ca34147aeb638e9d010e73c', 'request_id': 'req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.172574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:11.173523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:11.176676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:11.184760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff4714a1ca34147aeb638e9d010e73c', 'request_id': 'req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.199616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff4714a1ca34147aeb638e9d010e73c', 'request_id': 'req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.219198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] The token cache is being invalidate because project dff4714a1ca34147aeb638e9d010e73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:11.220075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.220822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.224469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 954/1921] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:10 2022] DELETE /identity/v3/projects/dff4714a1ca34147aeb638e9d010e73c => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:11.227292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:11.231470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:11.279218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fc2286-6d17-4108-9c9a-2f50462701d5 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:11.351548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3c442-5d6f-4f8e-84d6-4697d140dfaf admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:11.358955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:11.360300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:11.361164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:11.361656 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] PATH_INFO: `/v3/users/e06c68b6688b4534a38ca8c138a1b73a` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:11.363726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e06c68b6688b4534a38ca8c138a1b73a)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:11.367032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:11.373877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:11.374547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:11.374834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:11.375116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:11.377063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:11.391789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:11.394285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:11.396359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:11.411272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 968/1922] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:11.428877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e06c68b6688b4534a38ca8c138a1b73a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.442700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e06c68b6688b4534a38ca8c138a1b73a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.443905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e06c68b6688b4534a38ca8c138a1b73a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.444981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e06c68b6688b4534a38ca8c138a1b73a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.467640 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e06c68b6688b4534a38ca8c138a1b73a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.483017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 955/1923] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:11 2022] DELETE /identity/v3/users/e06c68b6688b4534a38ca8c138a1b73a => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:11.546933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:11.548478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:11.569868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05181-e193-4072-b8b9-06d97cc6f1d6 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:11.736562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:11.753489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:11.754622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:11.756215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:11.758921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:11.759365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] PATH_INFO: `/v3/projects/8dd35c89270f49ab918de81bf6e18f34` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:11.767733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd35c89270f49ab918de81bf6e18f34)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:11.783481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:11.802175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a447ad36-878d-4a0e-9bd7-3450c4dc0f63 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:11.829743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:11.830910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:11.831745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:11.832806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] PATH_INFO: `/v3/projects/db66e45768e04aad9d57e2f3767b24ef` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:11.834359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db66e45768e04aad9d57e2f3767b24ef)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:11.837887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:11.901251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd35c89270f49ab918de81bf6e18f34', 'request_id': 'req-be035876-2454-4574-a27a-7d95421aaea9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.910842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd35c89270f49ab918de81bf6e18f34', 'request_id': 'req-be035876-2454-4574-a27a-7d95421aaea9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.920765 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd35c89270f49ab918de81bf6e18f34', 'request_id': 'req-be035876-2454-4574-a27a-7d95421aaea9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.943150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] The token cache is being invalidate because project 8dd35c89270f49ab918de81bf6e18f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:11.943451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.945676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-be035876-2454-4574-a27a-7d95421aaea9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.949598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 969/1924] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:11 2022] DELETE /identity/v3/projects/8dd35c89270f49ab918de81bf6e18f34 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:11.953787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:11.954082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:11.954369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:11.957774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db66e45768e04aad9d57e2f3767b24ef', 'request_id': 'req-26f7fb5c-ca83-4a62-bb25-2216d7f66571'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.964498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:11.978991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db66e45768e04aad9d57e2f3767b24ef', 'request_id': 'req-26f7fb5c-ca83-4a62-bb25-2216d7f66571'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:11.997130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:11.997130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.009415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db66e45768e04aad9d57e2f3767b24ef', 'request_id': 'req-26f7fb5c-ca83-4a62-bb25-2216d7f66571'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.061286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] The token cache is being invalidate because project db66e45768e04aad9d57e2f3767b24ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:12.061572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.064562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.070048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 956/1925] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:11 2022] DELETE /identity/v3/projects/db66e45768e04aad9d57e2f3767b24ef => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:12.078055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:12.081405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.190512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 970/1926] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:12.192025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:12.202595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.243584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdb00a6-6d63-4395-a794-84be43814ae1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:12.263737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:12.265200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.265658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.266069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] PATH_INFO: `/v3/projects/32a8c01e2e3b4ce499ce95aad82222c7` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.267954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a8c01e2e3b4ce499ce95aad82222c7)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:12.270034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:12.271472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f7fb5c-ca83-4a62-bb25-2216d7f66571 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:12.282425 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:12.283334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.283608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.283894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] PATH_INFO: `/v3/users/6b56181affa745e5851358746ceebd6a` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.286699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b56181affa745e5851358746ceebd6a)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:12.288710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:12.325398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:12.365721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a8c01e2e3b4ce499ce95aad82222c7', 'request_id': 'req-49abdadf-6c27-4908-90dd-6ec2cea2df1c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.377749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a8c01e2e3b4ce499ce95aad82222c7', 'request_id': 'req-49abdadf-6c27-4908-90dd-6ec2cea2df1c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.380491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b56181affa745e5851358746ceebd6a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.386553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a8c01e2e3b4ce499ce95aad82222c7', 'request_id': 'req-49abdadf-6c27-4908-90dd-6ec2cea2df1c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.390541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b56181affa745e5851358746ceebd6a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.391254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b56181affa745e5851358746ceebd6a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.392052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b56181affa745e5851358746ceebd6a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.400816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] The token cache is being invalidate because project 32a8c01e2e3b4ce499ce95aad82222c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:12.401183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.402490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49abdadf-6c27-4908-90dd-6ec2cea2df1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.404316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 971/1927] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:12 2022] DELETE /identity/v3/projects/32a8c01e2e3b4ce499ce95aad82222c7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:12.405723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.406079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.406430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.409046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b56181affa745e5851358746ceebd6a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.422182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 957/1928] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:12 2022] DELETE /identity/v3/users/6b56181affa745e5851358746ceebd6a => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:12.423104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:12.424402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.426409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:12.427613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.504663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 972/1929] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:12.509820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:12.512128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.524977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444e999c-973f-4e63-8741-d15e9ae4cf40 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:12.529358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd81f-a11b-4077-8bb7-dc2f698f9f9d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:12.533960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:12.535093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.535546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.535921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] PATH_INFO: `/v3/projects/99c4dcbd4e65451d877c5b269ae6859e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.536692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:12.537838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.538181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=99c4dcbd4e65451d877c5b269ae6859e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:12.538302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.538624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] PATH_INFO: `/v3/users/672b3e80583744bdb268e8f7378b5c8b` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.540332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=672b3e80583744bdb268e8f7378b5c8b)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:12.541461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:12.543330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:12.544715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:12.606379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672b3e80583744bdb268e8f7378b5c8b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.620908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672b3e80583744bdb268e8f7378b5c8b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.632376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99c4dcbd4e65451d877c5b269ae6859e', 'request_id': 'req-360725c0-a1f5-4bff-9066-40baf2c81bf5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.639553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672b3e80583744bdb268e8f7378b5c8b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.640583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672b3e80583744bdb268e8f7378b5c8b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.646571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99c4dcbd4e65451d877c5b269ae6859e', 'request_id': 'req-360725c0-a1f5-4bff-9066-40baf2c81bf5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.654658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672b3e80583744bdb268e8f7378b5c8b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.660145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99c4dcbd4e65451d877c5b269ae6859e', 'request_id': 'req-360725c0-a1f5-4bff-9066-40baf2c81bf5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.665982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 973/1930] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:12 2022] DELETE /identity/v3/users/672b3e80583744bdb268e8f7378b5c8b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:12.669379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:12.671873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.688810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] The token cache is being invalidate because project 99c4dcbd4e65451d877c5b269ae6859e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:12.689112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.690642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-360725c0-a1f5-4bff-9066-40baf2c81bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:12.701335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 958/1931] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:12 2022] DELETE /identity/v3/projects/99c4dcbd4e65451d877c5b269ae6859e => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:12.703230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.703525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.703806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.754507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:12.756209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:12.759302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.851105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd2887-d1b3-494d-b39e-d900e9980c62 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:12.860152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:12.861684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.862298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.862846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.864108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:12.864754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:12.867477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:12.885539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 974/1932] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:12.893510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:12.893510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.893773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 959/1933] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:12.893773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:12.895106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:12.909456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea9ea-f354-46a2-91cf-52103ca2e995 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:12.913547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59521a91-1819-4758-97d1-fcf74b4d64eb admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:12.914999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738bf4b-d99e-4b3d-bcf7-848e7067adc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:12.915948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738bf4b-d99e-4b3d-bcf7-848e7067adc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.916336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738bf4b-d99e-4b3d-bcf7-848e7067adc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.916766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738bf4b-d99e-4b3d-bcf7-848e7067adc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.917713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738bf4b-d99e-4b3d-bcf7-848e7067adc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:12.919867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738bf4b-d99e-4b3d-bcf7-848e7067adc7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:12.920006 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:12.920958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.921248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.921528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] PATH_INFO: `/v3/projects/8f7f9c858d2242738cc2245a0ae81262` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.923010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f7f9c858d2242738cc2245a0ae81262)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:12.925095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:12.951916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 960/1934] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:12 2022] POST /identity/v3/projects => generated 367 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:12.953481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605f63-2ebe-4a7d-8e9b-881351489fab None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:12.953876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605f63-2ebe-4a7d-8e9b-881351489fab None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:12.954316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3605f63-2ebe-4a7d-8e9b-881351489fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:12.980801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c3605f63-2ebe-4a7d-8e9b-881351489fab None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:12.982936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c3605f63-2ebe-4a7d-8e9b-881351489fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.022110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f7f9c858d2242738cc2245a0ae81262', 'request_id': 'req-6063c099-e0e2-4f99-b678-0eeed060a570'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.035608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f7f9c858d2242738cc2245a0ae81262', 'request_id': 'req-6063c099-e0e2-4f99-b678-0eeed060a570'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.041948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f7f9c858d2242738cc2245a0ae81262', 'request_id': 'req-6063c099-e0e2-4f99-b678-0eeed060a570'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.054358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] The token cache is being invalidate because project 8f7f9c858d2242738cc2245a0ae81262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:13.054789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.055570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.057500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 975/1935] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:12 2022] DELETE /identity/v3/projects/8f7f9c858d2242738cc2245a0ae81262 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:13.061219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.062844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.077510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 961/1936] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:13.078943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924660dd-5165-44ff-afe1-9a3b1d49e223 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.079247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924660dd-5165-44ff-afe1-9a3b1d49e223 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.079563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924660dd-5165-44ff-afe1-9a3b1d49e223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.102074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-924660dd-5165-44ff-afe1-9a3b1d49e223 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:13.103232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-924660dd-5165-44ff-afe1-9a3b1d49e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.123393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:13.201879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6063c099-e0e2-4f99-b678-0eeed060a570 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.235168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.236132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.239534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.239870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.242340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.253721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.278741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 962/1937] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:13.280162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924660dd-5165-44ff-afe1-9a3b1d49e223 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.290793 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924660dd-5165-44ff-afe1-9a3b1d49e223 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.297058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7d0a02-1447-4dcd-8808-16beab5c2766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.297842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0a02-1447-4dcd-8808-16beab5c2766 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.298200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0a02-1447-4dcd-8808-16beab5c2766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.298563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7d0a02-1447-4dcd-8808-16beab5c2766 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.299923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d0a02-1447-4dcd-8808-16beab5c2766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:13.299923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d0a02-1447-4dcd-8808-16beab5c2766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.303793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 976/1938] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/users => generated 284 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:13.303924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7d0a02-1447-4dcd-8808-16beab5c2766 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.304016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.304016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.318302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 963/1939] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:13.318505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80519031-3caa-4496-8454-b49cf56fba87 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.319639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830732-2959-46d4-82ed-8e8d4c8d0090 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.319981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830732-2959-46d4-82ed-8e8d4c8d0090 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.320230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41830732-2959-46d4-82ed-8e8d4c8d0090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.325062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.326104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.326405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.326755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] PATH_INFO: `/v3/projects/51e4867565a2408e8837388a32188fc3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.328548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] RBAC: Authorizing `identity:delete_project(project_id=51e4867565a2408e8837388a32188fc3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.330810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.350806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-41830732-2959-46d4-82ed-8e8d4c8d0090 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:13.352586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-41830732-2959-46d4-82ed-8e8d4c8d0090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.362966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 964/1940] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:13.364020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830732-2959-46d4-82ed-8e8d4c8d0090 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.374865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:13.377133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41830732-2959-46d4-82ed-8e8d4c8d0090 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.384643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.385364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.385663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.386624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.387097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.388773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.402645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 965/1941] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:13.402645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.412344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aec5da5-c151-4483-8121-a7a7d5fb275a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.415962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51e4867565a2408e8837388a32188fc3', 'request_id': 'req-bd5918fc-fce0-41a6-b1d2-39dad356eadb'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.427251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51e4867565a2408e8837388a32188fc3', 'request_id': 'req-bd5918fc-fce0-41a6-b1d2-39dad356eadb'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.436009 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51e4867565a2408e8837388a32188fc3', 'request_id': 'req-bd5918fc-fce0-41a6-b1d2-39dad356eadb'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.454999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] The token cache is being invalidate because project 51e4867565a2408e8837388a32188fc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:13.455304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.456258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.458783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 977/1942] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:13 2022] DELETE /identity/v3/projects/51e4867565a2408e8837388a32188fc3 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:13.459933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.463216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.502765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.503670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.504058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.504479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.505705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.508258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.561990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 966/1943] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/projects => generated 379 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:13.563256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.568413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.576875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5918fc-fce0-41a6-b1d2-39dad356eadb admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.645911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a7ce1-4413-4d0b-8b32-2b265db4946b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.650530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5deb6-315c-4693-840f-a8adfa92739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.651205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5deb6-315c-4693-840f-a8adfa92739d admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.651492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5deb6-315c-4693-840f-a8adfa92739d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.652522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5deb6-315c-4693-840f-a8adfa92739d admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.653357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5deb6-315c-4693-840f-a8adfa92739d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.654946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.655082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5deb6-315c-4693-840f-a8adfa92739d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.655622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.655913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.656198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.656985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:13.657310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.658907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.660730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:13.666395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 967/1944] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:13.668139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.668642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.669351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.675397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 978/1945] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:13.676465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.680131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.695067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:13.696480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.699259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefb17ff-1b08-4a9c-98a2-1d77b3f94486 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.706075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.706980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.707266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.707549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] PATH_INFO: `/v3/users/8f4fe15b2b734bdd8e2a39ac134cdda8` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.707651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 968/1946] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:13.708711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.708845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f4fe15b2b734bdd8e2a39ac134cdda8)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.710319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.710790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.723982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9ef85-3b6d-4417-b8c1-4e110ee8cb82 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.728955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.729647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.730537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.730825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.731541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.733514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.759561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 969/1947] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/users => generated 290 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:13.761289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.765939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f4fe15b2b734bdd8e2a39ac134cdda8'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.767956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:13.772784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e49e3f2-7083-40bc-9ad4-fdd977dc9b7b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.777968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f4fe15b2b734bdd8e2a39ac134cdda8'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.778812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994103c1-27b1-4a7c-aa92-a6b9157eea5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.779825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994103c1-27b1-4a7c-aa92-a6b9157eea5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.780143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994103c1-27b1-4a7c-aa92-a6b9157eea5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.780786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994103c1-27b1-4a7c-aa92-a6b9157eea5a admin admin] PATH_INFO: `/v3/projects/52be45c82b024cc290e7710d971b22cf/users/7031e43fdd0643299e9b9cb78cb2d266/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.797909 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f4fe15b2b734bdd8e2a39ac134cdda8'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.798638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994103c1-27b1-4a7c-aa92-a6b9157eea5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=52be45c82b024cc290e7710d971b22cf, user_id=7031e43fdd0643299e9b9cb78cb2d266, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.798945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f4fe15b2b734bdd8e2a39ac134cdda8'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.801685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994103c1-27b1-4a7c-aa92-a6b9157eea5a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.808257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f4fe15b2b734bdd8e2a39ac134cdda8'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:13.819011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 979/1949] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:13 2022] DELETE /identity/v3/users/8f4fe15b2b734bdd8e2a39ac134cdda8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:13.819221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 970/1949] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:13 2022] PUT /identity/v3/projects/52be45c82b024cc290e7710d971b22cf/users/7031e43fdd0643299e9b9cb78cb2d266/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:13.827380 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.828695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.828695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.828695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.830531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.852034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:13.853309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.911172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a0149-5c7e-4182-accb-0def5348753f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.916837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf5b67d-97a4-40e9-9276-89eea1aa5094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.918149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5b67d-97a4-40e9-9276-89eea1aa5094 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.918406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5b67d-97a4-40e9-9276-89eea1aa5094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.918688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf5b67d-97a4-40e9-9276-89eea1aa5094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.919495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5b67d-97a4-40e9-9276-89eea1aa5094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.921448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf5b67d-97a4-40e9-9276-89eea1aa5094 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.923008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 971/1950] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:13.924090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:13.925589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.938354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8079acb-0d64-45ed-ab81-81aa040541dd None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:13.943505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6730d0-5198-4fb1-8dd4-023f7186e7e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:13.944271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6730d0-5198-4fb1-8dd4-023f7186e7e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.944496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6730d0-5198-4fb1-8dd4-023f7186e7e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.944781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6730d0-5198-4fb1-8dd4-023f7186e7e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.945519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6730d0-5198-4fb1-8dd4-023f7186e7e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:13.947141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6730d0-5198-4fb1-8dd4-023f7186e7e2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:13.951575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 980/1951] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/projects => generated 387 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:13.954559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f701-6d37-4b67-9211-d9b6cd8c8e3f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.955280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f701-6d37-4b67-9211-d9b6cd8c8e3f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.955660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa3f701-6d37-4b67-9211-d9b6cd8c8e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.960577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 972/1952] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:13.962468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34754bcb-6d4b-4e2a-9cb5-5e8d3ed1b736 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:13.962812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34754bcb-6d4b-4e2a-9cb5-5e8d3ed1b736 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:13.963100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34754bcb-6d4b-4e2a-9cb5-5e8d3ed1b736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:13.976450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6aa3f701-6d37-4b67-9211-d9b6cd8c8e3f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:13.977716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6aa3f701-6d37-4b67-9211-d9b6cd8c8e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:13.992795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-34754bcb-6d4b-4e2a-9cb5-5e8d3ed1b736 None None] MFA Rules not processed for user `7031e43fdd0643299e9b9cb78cb2d266`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:13.994548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-34754bcb-6d4b-4e2a-9cb5-5e8d3ed1b736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:14.059442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 981/1953] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:14.059442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f701-6d37-4b67-9211-d9b6cd8c8e3f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.067700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa3f701-6d37-4b67-9211-d9b6cd8c8e3f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.073298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.074550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.074842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.075119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.075983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:14.076450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.078091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.095353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 982/1954] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:14.095353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.105499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130203e-74eb-4e47-a85e-c9a78ece8999 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.109118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 973/1955] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:14.110199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34754bcb-6d4b-4e2a-9cb5-5e8d3ed1b736 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.112617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.113308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.113596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.113867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.114570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.117151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.126434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34754bcb-6d4b-4e2a-9cb5-5e8d3ed1b736 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.133088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.133814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.134128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.134413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.135300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.137043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.150915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 983/1956] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/users => generated 294 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:14.152332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.154534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:14.155316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 974/1957] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:14.156023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.170809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f06ae-5bdf-44b7-a660-c3cca0a5362b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.177754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45414-599f-4966-b19a-33c125771a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.178759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45414-599f-4966-b19a-33c125771a75 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.179073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45414-599f-4966-b19a-33c125771a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.179354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45414-599f-4966-b19a-33c125771a75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.180063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45414-599f-4966-b19a-33c125771a75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.182072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a45414-599f-4966-b19a-33c125771a75 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.202226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:INSERT=5,keystone:DELETE=3,keystone:SELECT=92 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:14.208956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:14.221744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 975/1958] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:14.227055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd43c30-9f34-487e-8977-6d03853d24f0 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.227345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd43c30-9f34-487e-8977-6d03853d24f0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.227623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd43c30-9f34-487e-8977-6d03853d24f0 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.229324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 976/1959] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:52:14.230702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd43c30-9f34-487e-8977-6d03853d24f0 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.232731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cfd43c30-9f34-487e-8977-6d03853d24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:14.274031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f52e0-fa11-4fa2-b4b3-47fa44393242 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.324824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd43c30-9f34-487e-8977-6d03853d24f0 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.330402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.331088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.331379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.331719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.332475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.335134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.345851 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.348747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.348747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.348747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.361246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.363186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.378131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 977/1960] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:14.378352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 984/1961] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:14.378447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.378531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.389332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee380653-8b70-43bb-8605-0986a93eb358 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.480518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3559aacd-474d-44a1-820c-315d5cb9e257 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.481379 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ca7a6-acd1-41db-87b7-518920e2f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.483209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca7a6-acd1-41db-87b7-518920e2f5d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.483685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca7a6-acd1-41db-87b7-518920e2f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.484116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ca7a6-acd1-41db-87b7-518920e2f5d7 admin admin] PATH_INFO: `/v3/projects/e6b5cded713e4745b1d0c9cb8c0c011e/users/0ccb3f94d9594228bd5a0ff5bc8881b3/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.486619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.487571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.487975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.488523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.489372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.491348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.507352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 978/1962] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:14.508347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.508651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ca7a6-acd1-41db-87b7-518920e2f5d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b5cded713e4745b1d0c9cb8c0c011e, user_id=0ccb3f94d9594228bd5a0ff5bc8881b3, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.513084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ca7a6-acd1-41db-87b7-518920e2f5d7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.526188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782c39f4-1870-4112-a569-16e60b34b339 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.534178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 985/1963] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:14 2022] PUT /identity/v3/projects/e6b5cded713e4745b1d0c9cb8c0c011e/users/0ccb3f94d9594228bd5a0ff5bc8881b3/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:14.535678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4710-54d8-4c6a-bea7-72cbe3ef35f8 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.536421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4710-54d8-4c6a-bea7-72cbe3ef35f8 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.536801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997b4710-54d8-4c6a-bea7-72cbe3ef35f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.561498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-997b4710-54d8-4c6a-bea7-72cbe3ef35f8 None None] MFA Rules not processed for user `5f39f1ea697c4426b30a5e6fa795e4e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:14.563730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-997b4710-54d8-4c6a-bea7-72cbe3ef35f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:14.628041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.628882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.630653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.630653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.630653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.633995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.673873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 979/1964] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:14.675176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.696494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:14.702141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c7d343-891c-4926-86be-f8aabf76532f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.709692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ee27db-422a-4062-99e0-730767a8553c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.710794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee27db-422a-4062-99e0-730767a8553c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.711539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee27db-422a-4062-99e0-730767a8553c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.712712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ee27db-422a-4062-99e0-730767a8553c admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.713876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee27db-422a-4062-99e0-730767a8553c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.716245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 986/1965] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:14.719578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ee27db-422a-4062-99e0-730767a8553c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.723945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b4710-54d8-4c6a-bea7-72cbe3ef35f8 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.735230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:14.736619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997b4710-54d8-4c6a-bea7-72cbe3ef35f8 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.742855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.743681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.743925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.744201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.745052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.746787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.754980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 980/1966] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/users => generated 290 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:14.757461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2965c-81dc-4297-9957-678cad6b7550 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.757877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2965c-81dc-4297-9957-678cad6b7550 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.758437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2965c-81dc-4297-9957-678cad6b7550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.762501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 987/1967] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:14.762501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.772826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa107ba6-56f0-47be-84e7-fdb4b46ae392 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.779676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.780256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.780565 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.780857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.781594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.785153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.795658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3db2965c-81dc-4297-9957-678cad6b7550 None None] MFA Rules not processed for user `0ccb3f94d9594228bd5a0ff5bc8881b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:14.797428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3db2965c-81dc-4297-9957-678cad6b7550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:14.800194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 988/1968] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:14.803707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.806804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:14.826930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c17b7b-dc98-4daf-a825-6aa1382d113d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.840587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.841268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.841559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.841841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.852340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.853963 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.873146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 989/1969] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:14.874301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.889785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dcde45-2abf-47a2-bc16-6f78015c34e6 service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.896012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.897119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.898166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.898460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.899321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.904156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 981/1970] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:14.904156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2965c-81dc-4297-9957-678cad6b7550 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.904955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.916044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2965c-81dc-4297-9957-678cad6b7550 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.917849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 990/1971] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:14.918734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.926545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.928315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.929043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.930270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] PATH_INFO: `/v3/projects/2132d24e19ea46f09ca7fd84ae42ad9e/users/3dfef87d2b384dbbbf47f386c166d0b2/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.938915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1161d457-411c-4cfb-9e9c-b3094ea1c35b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:14.946711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:14.947323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:14.947623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:14.947912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:14.949056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.950726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.955484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2132d24e19ea46f09ca7fd84ae42ad9e, user_id=3dfef87d2b384dbbbf47f386c166d0b2, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:14.958858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:14.963111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 991/1972] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:14.964124 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.966789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:14.974814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 982/1973] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:14 2022] PUT /identity/v3/projects/2132d24e19ea46f09ca7fd84ae42ad9e/users/3dfef87d2b384dbbbf47f386c166d0b2/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:14.975591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:14.987083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b239d58-ce6f-4b21-9dab-5b285277013c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.067317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.068253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.068567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.068896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] PATH_INFO: `/v3/projects/19f6fb1799524cda92f68c80a0022892` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.070149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f6fb1799524cda92f68c80a0022892)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.072146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.082757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186664e-bcdd-4987-a489-8d75df740e65 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.090385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.091271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.091385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.091691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.092573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.094955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.126336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 983/1974] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:14 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:15.130314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.140945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f6fb1799524cda92f68c80a0022892', 'request_id': 'req-1e82a93b-2605-4800-8b26-c17e4ba020e2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.152521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f6fb1799524cda92f68c80a0022892', 'request_id': 'req-1e82a93b-2605-4800-8b26-c17e4ba020e2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.160479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f6fb1799524cda92f68c80a0022892', 'request_id': 'req-1e82a93b-2605-4800-8b26-c17e4ba020e2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.185776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] The token cache is being invalidate because project 19f6fb1799524cda92f68c80a0022892 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:15.186555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.186887 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.190097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 992/1975] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:14 2022] DELETE /identity/v3/projects/19f6fb1799524cda92f68c80a0022892 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:15.190586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:15.190877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.192480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.220707 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa2722a-8633-4581-8ca8-1d2ce3518084 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.226249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ec502-8f86-4197-9719-95028dc60200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.227557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec502-8f86-4197-9719-95028dc60200 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.227856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec502-8f86-4197-9719-95028dc60200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.228180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ec502-8f86-4197-9719-95028dc60200 admin admin] PATH_INFO: `/v3/projects/6d3b8b29a8f741559da069df278f11c6/users/36996723465f47f9bf2b80c82d060216/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.247256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ec502-8f86-4197-9719-95028dc60200 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3b8b29a8f741559da069df278f11c6, user_id=36996723465f47f9bf2b80c82d060216, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.250099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ec502-8f86-4197-9719-95028dc60200 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.254333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:15.287514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 984/1976] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:15 2022] PUT /identity/v3/projects/6d3b8b29a8f741559da069df278f11c6/users/36996723465f47f9bf2b80c82d060216/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:15.288988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.289303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.289573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.332534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] MFA Rules not processed for user `3dfef87d2b384dbbbf47f386c166d0b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:15.333836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.334169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e82a93b-2605-4800-8b26-c17e4ba020e2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.410196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.411103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.411397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.411669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] PATH_INFO: `/v3/projects/5df20ff5c5fe468f948bf6e392aa502f/users/977b6977aa0241a0984fd247976b094e/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.424511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 985/1977] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:15.425648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.427216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.435240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5df20ff5c5fe468f948bf6e392aa502f, user_id=977b6977aa0241a0984fd247976b094e, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.438070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.445670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbf906-91dd-483a-bd31-90fded1730d1 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.451805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.452688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.453054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.453369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.454078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.456491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.456738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 993/1978] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:15 2022] PUT /identity/v3/projects/5df20ff5c5fe468f948bf6e392aa502f/users/977b6977aa0241a0984fd247976b094e/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:15.465991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.465991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.482860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 986/1979] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:15 2022] POST /identity/v3/users => generated 297 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:15.483809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.485775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.505408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818e4ab-0db6-42db-8e0e-596be06603d5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.548878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e50367-fee1-4893-9d72-38a90a7bd4f4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.554121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.555108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.555442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.555796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] PATH_INFO: `/v3/users/b4a5e4fc92fe4be783c0d9ed9bb1a857` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.557104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4a5e4fc92fe4be783c0d9ed9bb1a857)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.559836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.573214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.573898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.574192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.574476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.575319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.576968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.587910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 987/1980] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:15.588629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.593288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.607104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09552201-29a6-4e83-90b3-b799025165fb admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.611546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4a5e4fc92fe4be783c0d9ed9bb1a857'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.613721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7db02e-ba78-43eb-a7a5-053b23f9e295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.615701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7db02e-ba78-43eb-a7a5-053b23f9e295 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.615969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7db02e-ba78-43eb-a7a5-053b23f9e295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.616181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7db02e-ba78-43eb-a7a5-053b23f9e295 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.617382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7db02e-ba78-43eb-a7a5-053b23f9e295 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.620040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7db02e-ba78-43eb-a7a5-053b23f9e295 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.623225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4a5e4fc92fe4be783c0d9ed9bb1a857'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.629158 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:15.639739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4a5e4fc92fe4be783c0d9ed9bb1a857'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.640541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4a5e4fc92fe4be783c0d9ed9bb1a857'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.648770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4a5e4fc92fe4be783c0d9ed9bb1a857'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:15.651419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 988/1981] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:15 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:15.653790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.654083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.654364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.658527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 994/1982] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:15 2022] DELETE /identity/v3/users/b4a5e4fc92fe4be783c0d9ed9bb1a857 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:15.659336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.660934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.682114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:15.702481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] MFA Rules not processed for user `977b6977aa0241a0984fd247976b094e`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:15.704689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.741402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e69a3a4-d75a-4e03-b481-2accd9acf48c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.747204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.747891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.748374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.748682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.749421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.751091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.769557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 995/1983] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:15.770725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.772475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.791291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 989/1984] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:15.791911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.794417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.797492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b09b2f-8edd-4d95-ad53-ad425fe5b331 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.805203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.806761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.807915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.808480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] PATH_INFO: `/v3/projects/6d3b8b29a8f741559da069df278f11c6/users/36996723465f47f9bf2b80c82d060216/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.809874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d7f03a-0484-4fb6-8038-ffbe0d878eb8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.811323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d3b8b29a8f741559da069df278f11c6, user_id=36996723465f47f9bf2b80c82d060216, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.814390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.818951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.819750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.820055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.820473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.821359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.824689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:15.858978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 996/1985] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:15 2022] PUT /identity/v3/projects/6d3b8b29a8f741559da069df278f11c6/users/36996723465f47f9bf2b80c82d060216/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:15.860060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.864274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 990/1986] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:15 2022] POST /identity/v3/users => generated 300 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:15.865214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:15.883285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:15.898742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185e435-1e83-4dba-853b-089371b434b4 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.972239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f26d5f-27a8-4337-bd24-f04a01db68d1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:15.977470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.978497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.978968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.979449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] PATH_INFO: `/v3/projects/208fae300ac245a6911dbb5f03e85577/users/9c9376f27a8947c788f067c6c8379403/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.981399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c8182c-9f34-446e-aa81-0ab2420161f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:15.982150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8182c-9f34-446e-aa81-0ab2420161f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:15.982436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8182c-9f34-446e-aa81-0ab2420161f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:15.982716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c8182c-9f34-446e-aa81-0ab2420161f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:15.983422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8182c-9f34-446e-aa81-0ab2420161f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:15.986562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c8182c-9f34-446e-aa81-0ab2420161f7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.002199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208fae300ac245a6911dbb5f03e85577, user_id=9c9376f27a8947c788f067c6c8379403, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.007240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.021041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 991/1987] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:15 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:16.025145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 997/1988] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:15 2022] PUT /identity/v3/projects/208fae300ac245a6911dbb5f03e85577/users/9c9376f27a8947c788f067c6c8379403/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:16.026197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b2e2-e6a7-4084-9f25-8d839e8ba94a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.026319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.026818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b2e2-e6a7-4084-9f25-8d839e8ba94a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.027261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c991b2e2-e6a7-4084-9f25-8d839e8ba94a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.060069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c991b2e2-e6a7-4084-9f25-8d839e8ba94a None None] MFA Rules not processed for user `36996723465f47f9bf2b80c82d060216`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:16.061371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c991b2e2-e6a7-4084-9f25-8d839e8ba94a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.102961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:16.127150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16a3c2-10fe-4116-8df7-921503304462 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.137005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:16.149662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 992/1989] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:16.150707 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b2e2-e6a7-4084-9f25-8d839e8ba94a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.204427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.204977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.205264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.205639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.206404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.208068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.222526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 998/1990] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:16.222526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.226838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c991b2e2-e6a7-4084-9f25-8d839e8ba94a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.232572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.233709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.234016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.234334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.234619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5e9902-24e3-45ae-9482-7fb15e26ccf5 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.235034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.237152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.239460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.240132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.240472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.240730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.241455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.243191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.255357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 999/1991] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:16.256363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.258924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.264980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 993/1992] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:16 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:16.266013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.268944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.273622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348587eb-918f-41f5-8d5d-0df5a4f0e7b7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.279448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.280339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.280666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.280950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] PATH_INFO: `/v3/projects/60d679860bcc4b62983488a084d066ef` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.282167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60d679860bcc4b62983488a084d066ef)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.284093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.344215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef32896f-9ec9-4383-8c2e-d123efd31423 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.353340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60d679860bcc4b62983488a084d066ef', 'request_id': 'req-1b0a48be-ee74-430c-907d-8e295775ba02'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.363723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60d679860bcc4b62983488a084d066ef', 'request_id': 'req-1b0a48be-ee74-430c-907d-8e295775ba02'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.375420 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60d679860bcc4b62983488a084d066ef', 'request_id': 'req-1b0a48be-ee74-430c-907d-8e295775ba02'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.390559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] The token cache is being invalidate because project 60d679860bcc4b62983488a084d066ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:16.390857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.391551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.393426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1000/1993] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:16 2022] DELETE /identity/v3/projects/60d679860bcc4b62983488a084d066ef => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:16.393974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.395363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.410170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.411243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.411686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.412272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.414343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.462839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:16.469574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0a48be-ee74-430c-907d-8e295775ba02 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.479208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.480965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:16.481244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.481593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.482012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] PATH_INFO: `/v3/projects/ef73f7b4ce654e528745aa2d39395fbb/users/2ba44f6b77f04a6cbdd48c9afcb2c035/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.499510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.501170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.502585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef73f7b4ce654e528745aa2d39395fbb, user_id=2ba44f6b77f04a6cbdd48c9afcb2c035, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.505333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.514598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 994/1994] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:16.515347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.517169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.520880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1001/1995] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:16 2022] PUT /identity/v3/projects/ef73f7b4ce654e528745aa2d39395fbb/users/2ba44f6b77f04a6cbdd48c9afcb2c035/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:16.521741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.524102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.536720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e08c5-a6a1-4c53-8ec9-efd78854ba10 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.650503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caeb4d4-9bd7-47af-bfad-1907a2613133 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.656724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.657862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.658305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.659082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.660127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.662177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.668620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.669706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.669706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.670054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] PATH_INFO: `/v3/projects/208fae300ac245a6911dbb5f03e85577/users/9c9376f27a8947c788f067c6c8379403/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.676329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=208fae300ac245a6911dbb5f03e85577, user_id=9c9376f27a8947c788f067c6c8379403, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.679811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.682401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1002/1996] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:16.684121 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.685915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.698595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 995/1997] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:16 2022] PUT /identity/v3/projects/208fae300ac245a6911dbb5f03e85577/users/9c9376f27a8947c788f067c6c8379403/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:16.699658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.716484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39958f6f-e6e3-4274-acc1-93dcc61a1721 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.798950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891c19c4-96df-408e-9b23-5a0ebd784d42 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.806428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.807319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.807609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.808564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] PATH_INFO: `/v3/users/07c36accfa644677a1470332545cb5dc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.809873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=07c36accfa644677a1470332545cb5dc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.811831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.812527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.813227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.813528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.813822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.814608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.816249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.828426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 996/1998] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:16.828426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.830127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.866255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07c36accfa644677a1470332545cb5dc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.874928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07c36accfa644677a1470332545cb5dc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.888398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07c36accfa644677a1470332545cb5dc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.889125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07c36accfa644677a1470332545cb5dc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.891139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c2ad90-04e3-4473-8356-3366cf34af8f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:16.894665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:16.894911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f54a0-0707-4174-bd7e-8d0636187653 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:16.895827 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f54a0-0707-4174-bd7e-8d0636187653 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.896119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f54a0-0707-4174-bd7e-8d0636187653 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.896519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f54a0-0707-4174-bd7e-8d0636187653 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:16.897638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07c36accfa644677a1470332545cb5dc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:16.898698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-af2f54a0-0707-4174-bd7e-8d0636187653 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.905382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1003/1999] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:16 2022] DELETE /identity/v3/users/07c36accfa644677a1470332545cb5dc => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:16.906410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:16.908523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:16.937485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:16.972823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f54a0-0707-4174-bd7e-8d0636187653 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:16.974949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f54a0-0707-4174-bd7e-8d0636187653 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:16.988474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 997/2000] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:16 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:16.990258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330c78f-7a51-4226-a4e8-14deddae3475 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:16.990717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330c78f-7a51-4226-a4e8-14deddae3475 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:16.991165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d330c78f-7a51-4226-a4e8-14deddae3475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.026545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d330c78f-7a51-4226-a4e8-14deddae3475 None None] MFA Rules not processed for user `9c9376f27a8947c788f067c6c8379403`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:17.028233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d330c78f-7a51-4226-a4e8-14deddae3475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:17.041627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78415b50-cc4a-4e08-9ebc-ec884ef7de4d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:17.058900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:17.059826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.060118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.063257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] PATH_INFO: `/v3/projects/2ab0d363fbe746c5a05266ed1466abc9/users/d66a8ccf6e2a49eaa01c907e90cfe4ed/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.079776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab0d363fbe746c5a05266ed1466abc9, user_id=d66a8ccf6e2a49eaa01c907e90cfe4ed, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:17.084466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:17.102993 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1004/2001] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:16 2022] PUT /identity/v3/projects/2ab0d363fbe746c5a05266ed1466abc9/users/d66a8ccf6e2a49eaa01c907e90cfe4ed/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:17.104066 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:17.106157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:17.183518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 998/2002] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:16 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:17.185684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330c78f-7a51-4226-a4e8-14deddae3475 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:17.198192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d330c78f-7a51-4226-a4e8-14deddae3475 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:17.258698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467576e2-3bd8-4b87-a293-47b83425e0b4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:17.265826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:17.266769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.267581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.267876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] PATH_INFO: `/v3/projects/ef73f7b4ce654e528745aa2d39395fbb/users/2ba44f6b77f04a6cbdd48c9afcb2c035/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.272862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef73f7b4ce654e528745aa2d39395fbb, user_id=2ba44f6b77f04a6cbdd48c9afcb2c035, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:17.279588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:17.296023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1005/2003] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:17 2022] PUT /identity/v3/projects/ef73f7b4ce654e528745aa2d39395fbb/users/2ba44f6b77f04a6cbdd48c9afcb2c035/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:17.297234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:17.300172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6dae2-b6aa-423b-8530-7b65e816974d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:17.300898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6dae2-b6aa-423b-8530-7b65e816974d admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.301187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6dae2-b6aa-423b-8530-7b65e816974d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.301467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6dae2-b6aa-423b-8530-7b65e816974d admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.302215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6dae2-b6aa-423b-8530-7b65e816974d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:17.304558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6dae2-b6aa-423b-8530-7b65e816974d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:17.308314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:17.331677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 999/2004] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:17.333125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690e204-936e-4d29-9eea-13dde5ec7c75 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.333478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690e204-936e-4d29-9eea-13dde5ec7c75 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.334437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690e204-936e-4d29-9eea-13dde5ec7c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.379629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1690e204-936e-4d29-9eea-13dde5ec7c75 None None] MFA Rules not processed for user `2ba44f6b77f04a6cbdd48c9afcb2c035`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:17.381712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1690e204-936e-4d29-9eea-13dde5ec7c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:17.416061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c910b16-f7de-48bf-9cfa-f603444ecd11 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:17.420933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:17.422550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.423431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.424771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.453840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:17.460091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:17.504018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1000/2005] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:17.507426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690e204-936e-4d29-9eea-13dde5ec7c75 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:17.530883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:17.533582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:17.547626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1006/2006] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:17 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:17.549472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:17.551921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:17.618413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690e204-936e-4d29-9eea-13dde5ec7c75 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:17.627227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:17.628369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.629051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.629544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] PATH_INFO: `/v3/projects/2ab0d363fbe746c5a05266ed1466abc9/users/d66a8ccf6e2a49eaa01c907e90cfe4ed/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.632559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab0d363fbe746c5a05266ed1466abc9, user_id=d66a8ccf6e2a49eaa01c907e90cfe4ed, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:17.637279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:17.661511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1001/2007] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:17 2022] PUT /identity/v3/projects/2ab0d363fbe746c5a05266ed1466abc9/users/d66a8ccf6e2a49eaa01c907e90cfe4ed/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:17.666121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:17.670705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:17.698164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ae044-1f3f-4765-b2a4-090888a43b72 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:17.780887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee0ec2-341b-410f-8cf8-c97d646b47b9 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:17.788457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24631b38-644e-452c-b9fa-462c52744154 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:17.788658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631b38-644e-452c-b9fa-462c52744154 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.788913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631b38-644e-452c-b9fa-462c52744154 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.789449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24631b38-644e-452c-b9fa-462c52744154 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.791450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:17.793003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.793515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.793899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] PATH_INFO: `/v3/projects/1d3f09eec5dc4f00aed0a9cc52562926` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.795369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3f09eec5dc4f00aed0a9cc52562926)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:17.798606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:17.885024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3f09eec5dc4f00aed0a9cc52562926', 'request_id': 'req-bed51f5e-4527-472f-99fa-ad6f8513267e'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:17.903223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3f09eec5dc4f00aed0a9cc52562926', 'request_id': 'req-bed51f5e-4527-472f-99fa-ad6f8513267e'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:17.914022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3f09eec5dc4f00aed0a9cc52562926', 'request_id': 'req-bed51f5e-4527-472f-99fa-ad6f8513267e'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:17.926379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631b38-644e-452c-b9fa-462c52744154 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:17.928936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24631b38-644e-452c-b9fa-462c52744154 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:17.929389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:17.937960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] The token cache is being invalidate because project 1d3f09eec5dc4f00aed0a9cc52562926 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:17.938289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:17.939712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bed51f5e-4527-472f-99fa-ad6f8513267e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:17.941674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1007/2008] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:17 2022] DELETE /identity/v3/projects/1d3f09eec5dc4f00aed0a9cc52562926 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:17.943070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.944057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.944608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.949996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1002/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:17 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:17.951487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:17.951725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:17.951987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:17.978978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:17.982114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:17.991549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] MFA Rules not processed for user `d66a8ccf6e2a49eaa01c907e90cfe4ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:17.996958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:18.036255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:18.117082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1008/2010] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:18.140603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.142299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:18.148235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1003/2011] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:18.149032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.150540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:18.230247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006566e0-92ea-49ca-9ec4-9eb4b6dc49b7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.235100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a0b51a-bd7a-49fa-9a27-5b496232e49f tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9376f27a8947c788f067c6c8379403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '208fae300ac245a6911dbb5f03e85577', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.235780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b51a-bd7a-49fa-9a27-5b496232e49f tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.236072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b51a-bd7a-49fa-9a27-5b496232e49f tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.236365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a0b51a-bd7a-49fa-9a27-5b496232e49f tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.237138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b51a-bd7a-49fa-9a27-5b496232e49f tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:18.237441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b51a-bd7a-49fa-9a27-5b496232e49f tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.239176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a0b51a-bd7a-49fa-9a27-5b496232e49f tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.253347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2982e8c6-ab5d-4f6c-a3e5-c2fb31c1fe59 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.263987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1009/2012] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:18.263987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e4d4f-c302-40cc-9270-c8ce6be4512c None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.263987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e4d4f-c302-40cc-9270-c8ce6be4512c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.267180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32e4d4f-c302-40cc-9270-c8ce6be4512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.267596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.268496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.269042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.269933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.272405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:18.293915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e32e4d4f-c302-40cc-9270-c8ce6be4512c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:18.295154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e32e4d4f-c302-40cc-9270-c8ce6be4512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:18.303568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1010/2013] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:18.304460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e4d4f-c302-40cc-9270-c8ce6be4512c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.317897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32e4d4f-c302-40cc-9270-c8ce6be4512c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.334529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9376f27a8947c788f067c6c8379403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '208fae300ac245a6911dbb5f03e85577', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.335212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.335508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.335794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.336629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.342515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.368038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.371158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.395172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1004/2014] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:18.398258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.405055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1011/2015] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:18 2022] POST /identity/v3/projects => generated 354 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:18.407884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.423197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542b4ece-100a-460e-be7f-b00fd2267678 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.497342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:18.513976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874104e5-64ce-4860-b921-6afda19bf76b tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.519791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9376f27a8947c788f067c6c8379403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '208fae300ac245a6911dbb5f03e85577', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.520917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.521318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.521677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.522513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:18.523306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.525127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.540710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1012/2016] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:18.549621 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.550331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.550627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.550914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.551715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:18.552078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.554232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.575200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1005/2017] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:18.579870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.595468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56605e28-f7f4-41d5-b76e-d617c90014be tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.600663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.616053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.617258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.618803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.619468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.623382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.627381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.628665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d6e0b8-3fbd-4eb7-ad57-3e68af4056ef admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.638631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9c9376f27a8947c788f067c6c8379403', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '208fae300ac245a6911dbb5f03e85577', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.639860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.640325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.640896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] PATH_INFO: `/v3/projects/bf8670055c4b4530b618e06bbffd3fe4` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.642328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorizing `identity:delete_project(project_id=bf8670055c4b4530b618e06bbffd3fe4)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.646446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.662949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:18.699627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1013/2018] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:18 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:18.699627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:18.760189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf8670055c4b4530b618e06bbffd3fe4', 'request_id': 'req-6e5ed070-06a9-4907-991c-db5ac648f0cb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:18.771404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf8670055c4b4530b618e06bbffd3fe4', 'request_id': 'req-6e5ed070-06a9-4907-991c-db5ac648f0cb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:18.786359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf8670055c4b4530b618e06bbffd3fe4', 'request_id': 'req-6e5ed070-06a9-4907-991c-db5ac648f0cb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:18.811992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] The token cache is being invalidate because project bf8670055c4b4530b618e06bbffd3fe4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:18.812576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:18.813613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:18.819343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1006/2019] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:18 2022] DELETE /identity/v3/projects/bf8670055c4b4530b618e06bbffd3fe4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:18.831042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4e75db-6161-49bc-aa3b-cfaf31f3d213 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:18.946164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:18.947182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:18.947891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:18.949631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:18.951453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:18.957115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:18.995924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1014/2020] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:18 2022] POST /identity/v3/users => generated 287 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:18.998009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.000056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.021674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ed070-06a9-4907-991c-db5ac648f0cb tempest-VolumeQuotaClassesTest-1116087028 tempest-VolumeQuotaClassesTest-1116087028-project-admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.034894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.035591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.036682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.036974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.041308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.044982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.062800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1007/2021] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:19.066751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.079526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a9ac17-e135-42ab-8687-6549f85f2aab admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.085653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.087175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.087474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.087797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.089187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.091273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.107522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1015/2022] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:19.108702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.121361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909cc6e-6bb5-4427-b3ba-05afe2cb8ffe admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.129946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ac7f1a-5fd7-44bc-86bd-cb8dc0773929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.131382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7f1a-5fd7-44bc-86bd-cb8dc0773929 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.131696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7f1a-5fd7-44bc-86bd-cb8dc0773929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.132252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ac7f1a-5fd7-44bc-86bd-cb8dc0773929 admin admin] PATH_INFO: `/v3/projects/7f76653418e74507a6546c87f864da20/users/6c37e86a9abd4bc5905a999024c32f3f/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.159767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.162335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.182238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03471abb-1965-41a7-a4b0-348c490b4e66 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.185608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac7f1a-5fd7-44bc-86bd-cb8dc0773929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f76653418e74507a6546c87f864da20, user_id=6c37e86a9abd4bc5905a999024c32f3f, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.188361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ac7f1a-5fd7-44bc-86bd-cb8dc0773929 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.198032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.199019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.199320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.199642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] PATH_INFO: `/v3/users/3dfef87d2b384dbbbf47f386c166d0b2` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.202437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dfef87d2b384dbbbf47f386c166d0b2)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.204869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.218705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1008/2023] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:19 2022] PUT /identity/v3/projects/7f76653418e74507a6546c87f864da20/users/6c37e86a9abd4bc5905a999024c32f3f/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:19.234807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf3f6-bea0-4ec7-bd02-af2c187a86bf None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.235112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf3f6-bea0-4ec7-bd02-af2c187a86bf None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.235696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dadf3f6-bea0-4ec7-bd02-af2c187a86bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.291642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-8dadf3f6-bea0-4ec7-bd02-af2c187a86bf None None] MFA Rules not processed for user `6c37e86a9abd4bc5905a999024c32f3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:19.293649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8dadf3f6-bea0-4ec7-bd02-af2c187a86bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.327262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:19.330879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dfef87d2b384dbbbf47f386c166d0b2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.344116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dfef87d2b384dbbbf47f386c166d0b2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.364412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dfef87d2b384dbbbf47f386c166d0b2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.365438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dfef87d2b384dbbbf47f386c166d0b2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.374753 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dfef87d2b384dbbbf47f386c166d0b2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.386524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1016/2024] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:19 2022] DELETE /identity/v3/users/3dfef87d2b384dbbbf47f386c166d0b2 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:19.387920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.389884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.428522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1009/2025] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:19.432594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.434937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.435378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.460070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:19.461505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.470786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1010/2026] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:19.471805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.473237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a978a2-5b58-46db-8f30-b74213b51405 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.473690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.481566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.482466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.482806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.483095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] PATH_INFO: `/v3/users/0ccb3f94d9594228bd5a0ff5bc8881b3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.484346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ccb3f94d9594228bd5a0ff5bc8881b3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.486548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.490380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa2d2c-adc8-4877-8ee6-436d4e3d7127 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.498983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.499815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.500356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.500777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.502057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.505457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.546114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1011/2027] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:19 2022] POST /identity/v3/projects => generated 375 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:19.547207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.550823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.553114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ccb3f94d9594228bd5a0ff5bc8881b3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.563880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ccb3f94d9594228bd5a0ff5bc8881b3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.585261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:19.585852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ccb3f94d9594228bd5a0ff5bc8881b3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.586940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ccb3f94d9594228bd5a0ff5bc8881b3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.606951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ccb3f94d9594228bd5a0ff5bc8881b3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:19.616051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1017/2028] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:19 2022] DELETE /identity/v3/users/0ccb3f94d9594228bd5a0ff5bc8881b3 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:19.617329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.619103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.642984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff522b-e607-4da9-9adb-6617da4ed117 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.708252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.709190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.709623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.710076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.712552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.713341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:19.743308 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3690ad5c-28ae-4212-aa47-554633e99f34 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.748764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f54c6d-8aba-4f3d-8218-a101102897f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.749457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f54c6d-8aba-4f3d-8218-a101102897f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.749772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f54c6d-8aba-4f3d-8218-a101102897f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.750063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f54c6d-8aba-4f3d-8218-a101102897f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.750768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f54c6d-8aba-4f3d-8218-a101102897f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.752755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f54c6d-8aba-4f3d-8218-a101102897f0 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.775583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1018/2029] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:19 2022] POST /identity/v3/users => generated 294 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:19.777891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1fc4-1fcf-4680-86a4-67063c7915e7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.778190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1fc4-1fcf-4680-86a4-67063c7915e7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.778475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a1fc4-1fcf-4680-86a4-67063c7915e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.799278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-c66a1fc4-1fcf-4680-86a4-67063c7915e7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:19.799528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.800900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.801016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c66a1fc4-1fcf-4680-86a4-67063c7915e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.809652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1019/2030] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:19.812057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1012/2031] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:19.813447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1fc4-1fcf-4680-86a4-67063c7915e7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.823825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a1fc4-1fcf-4680-86a4-67063c7915e7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.827121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.829911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.830712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.831129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.831488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.832450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.834185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.849739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:19.853739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1020/2032] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:19.855008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.866302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb70304-4f58-474e-b7db-50973e902411 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.867616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599deee-574a-4d0c-9ec0-1663e75f43bf service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:19.875043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.875893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.876654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.877009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.888322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:19.891367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:19.891863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:19.892369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] PATH_INFO: `/v3/projects/3bc57e01cc14484fa48b46377d3ef38f/users/cb7b7be511e54164917d845288102edf/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:19.892970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.895170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.914799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1013/2033] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:19.921431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc57e01cc14484fa48b46377d3ef38f, user_id=cb7b7be511e54164917d845288102edf, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:19.924901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:19.942213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1021/2034] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:19 2022] PUT /identity/v3/projects/3bc57e01cc14484fa48b46377d3ef38f/users/cb7b7be511e54164917d845288102edf/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:19.946738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:19.961100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d14e19-ffc6-48af-9f39-e4567c85bd21 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:20.034872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4928fec-5562-4c98-8ed4-2de4b65d0dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:20.035683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4928fec-5562-4c98-8ed4-2de4b65d0dd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:20.036035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4928fec-5562-4c98-8ed4-2de4b65d0dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:20.036398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4928fec-5562-4c98-8ed4-2de4b65d0dd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:20.037255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4928fec-5562-4c98-8ed4-2de4b65d0dd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:20.040347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4928fec-5562-4c98-8ed4-2de4b65d0dd7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:20.056565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1014/2035] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:20.057427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:20.072547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0154cd-8396-41b2-a39c-8af8b0729421 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:20.081969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:20.083038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:20.083344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:20.083633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] PATH_INFO: `/v3/projects/3bc57e01cc14484fa48b46377d3ef38f/users/cb7b7be511e54164917d845288102edf/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:20.088102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bc57e01cc14484fa48b46377d3ef38f, user_id=cb7b7be511e54164917d845288102edf, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:20.092288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:20.113538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1022/2036] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:20 2022] PUT /identity/v3/projects/3bc57e01cc14484fa48b46377d3ef38f/users/cb7b7be511e54164917d845288102edf/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:20.132989 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:20.133608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:20.134111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:20.160252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:20.179738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] MFA Rules not processed for user `cb7b7be511e54164917d845288102edf`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:20.181738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:20.289590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1015/2037] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:20.351980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:20.355368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:20.461893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:20.463448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:20.545516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e282e4-1088-49f0-98b5-35fc188d5e9e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:20.550840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:20.551754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:20.552065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:20.552354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:20.554431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:20.650260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7476f92f-20d2-4d8b-a449-b8c56af01370 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:20.676861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:20.679825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:20.682409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:20.688857 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:20.689234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:20.690807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] PATH_INFO: `/v3/projects/2132d24e19ea46f09ca7fd84ae42ad9e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:20.694027 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2132d24e19ea46f09ca7fd84ae42ad9e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:20.697088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:20.734110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1023/2038] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:20.823550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2132d24e19ea46f09ca7fd84ae42ad9e', 'request_id': 'req-1788602a-d011-46b8-9af6-611635a8d241'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:20.841545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2132d24e19ea46f09ca7fd84ae42ad9e', 'request_id': 'req-1788602a-d011-46b8-9af6-611635a8d241'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:20.865199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:20.865199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:20.865376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2132d24e19ea46f09ca7fd84ae42ad9e', 'request_id': 'req-1788602a-d011-46b8-9af6-611635a8d241'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:20.880199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] The token cache is being invalidate because project 2132d24e19ea46f09ca7fd84ae42ad9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:20.882464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:20.883881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:20.885036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faf7eb-de78-4479-8fcb-b8dbfb0a632b service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:20.889212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1016/2039] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:20 2022] DELETE /identity/v3/projects/2132d24e19ea46f09ca7fd84ae42ad9e => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:20.893713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:20.896234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:20.989097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:21.060023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:21.111103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:21.112001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:21.112299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:21.112603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] PATH_INFO: `/v3/projects/e6b5cded713e4745b1d0c9cb8c0c011e` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:21.115493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b5cded713e4745b1d0c9cb8c0c011e)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:21.122414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:21.169538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1788602a-d011-46b8-9af6-611635a8d241 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:21.177465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:21.179029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:21.179367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:21.179914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] PATH_INFO: `/v3/users/2ba44f6b77f04a6cbdd48c9afcb2c035` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:21.183107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ba44f6b77f04a6cbdd48c9afcb2c035)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:21.186892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:21.309137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ba44f6b77f04a6cbdd48c9afcb2c035'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.330179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b5cded713e4745b1d0c9cb8c0c011e', 'request_id': 'req-0d7517c6-00cc-4749-99b9-e9da01cba329'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.339554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ba44f6b77f04a6cbdd48c9afcb2c035'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.340800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ba44f6b77f04a6cbdd48c9afcb2c035'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.342008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ba44f6b77f04a6cbdd48c9afcb2c035'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.359070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b5cded713e4745b1d0c9cb8c0c011e', 'request_id': 'req-0d7517c6-00cc-4749-99b9-e9da01cba329'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.371570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b5cded713e4745b1d0c9cb8c0c011e', 'request_id': 'req-0d7517c6-00cc-4749-99b9-e9da01cba329'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.376085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ba44f6b77f04a6cbdd48c9afcb2c035'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.410356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1017/2040] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:20 2022] DELETE /identity/v3/users/2ba44f6b77f04a6cbdd48c9afcb2c035 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:21.424323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] The token cache is being invalidate because project e6b5cded713e4745b1d0c9cb8c0c011e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:21.424653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.435731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.437797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1024/2041] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:20 2022] DELETE /identity/v3/projects/e6b5cded713e4745b1d0c9cb8c0c011e => generated 0 bytes in 585 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:21.442448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:21.448726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:21.664311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4887251-3bf7-4fd2-944a-b8dd9740935f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:21.676621 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:21.677517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:21.677804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:21.678085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] PATH_INFO: `/v3/users/9c9376f27a8947c788f067c6c8379403` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:21.681192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c9376f27a8947c788f067c6c8379403)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:21.683833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:21.772375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c9376f27a8947c788f067c6c8379403'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.778669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:21.795502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c9376f27a8947c788f067c6c8379403'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.797169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c9376f27a8947c788f067c6c8379403'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.798462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c9376f27a8947c788f067c6c8379403'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.821186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c9376f27a8947c788f067c6c8379403'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:21.858757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1018/2042] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:21 2022] DELETE /identity/v3/users/9c9376f27a8947c788f067c6c8379403 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:22.747971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:22.749708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:22.843247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7517c6-00cc-4749-99b9-e9da01cba329 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:22.942693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:22.944169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:22.944169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:22.944169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] PATH_INFO: `/v3/projects/ef73f7b4ce654e528745aa2d39395fbb` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:22.945429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef73f7b4ce654e528745aa2d39395fbb)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:22.949791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:22.961800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:22.997351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.004626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:23.036616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae800bcc-813a-49ab-b93a-ad6d5a37d9de admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.038540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef73f7b4ce654e528745aa2d39395fbb', 'request_id': 'req-c37d42a8-d52d-427c-b441-95836e5f4677'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.059823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef73f7b4ce654e528745aa2d39395fbb', 'request_id': 'req-c37d42a8-d52d-427c-b441-95836e5f4677'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.069987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef73f7b4ce654e528745aa2d39395fbb', 'request_id': 'req-c37d42a8-d52d-427c-b441-95836e5f4677'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.092350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] The token cache is being invalidate because project ef73f7b4ce654e528745aa2d39395fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:23.092675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.096861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c37d42a8-d52d-427c-b441-95836e5f4677 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.099090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1025/2043] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:22 2022] DELETE /identity/v3/projects/ef73f7b4ce654e528745aa2d39395fbb => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:23.106323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2f1f-4959-404e-9d02-52e35fa29eac None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.106636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2f1f-4959-404e-9d02-52e35fa29eac None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.106919 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065a2f1f-4959-404e-9d02-52e35fa29eac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.142991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-065a2f1f-4959-404e-9d02-52e35fa29eac None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:23.144273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-065a2f1f-4959-404e-9d02-52e35fa29eac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:23.163680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:23.165146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.165637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.166083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] PATH_INFO: `/v3/projects/208fae300ac245a6911dbb5f03e85577` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.167876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=208fae300ac245a6911dbb5f03e85577)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:23.170120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:23.258293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '208fae300ac245a6911dbb5f03e85577', 'request_id': 'req-251831f1-05dc-4c4d-a203-0689d6a542f2'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.267754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '208fae300ac245a6911dbb5f03e85577', 'request_id': 'req-251831f1-05dc-4c4d-a203-0689d6a542f2'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.283900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '208fae300ac245a6911dbb5f03e85577', 'request_id': 'req-251831f1-05dc-4c4d-a203-0689d6a542f2'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.297524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1026/2044] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:23.305444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc70a5-ffb7-4342-ad99-213992790a12 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.305778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc70a5-ffb7-4342-ad99-213992790a12 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.306562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc70a5-ffb7-4342-ad99-213992790a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.312421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] The token cache is being invalidate because project 208fae300ac245a6911dbb5f03e85577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:23.313506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.316201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-251831f1-05dc-4c4d-a203-0689d6a542f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:23.319459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1019/2045] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:22 2022] DELETE /identity/v3/projects/208fae300ac245a6911dbb5f03e85577 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:23.325967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dba66-ca5f-4ef2-8443-77d697143dc3 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.326581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dba66-ca5f-4ef2-8443-77d697143dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.328828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36dba66-ca5f-4ef2-8443-77d697143dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.355032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9adc70a5-ffb7-4342-ad99-213992790a12 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:23.358457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9adc70a5-ffb7-4342-ad99-213992790a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:23.363325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f36dba66-ca5f-4ef2-8443-77d697143dc3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:23.367348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f36dba66-ca5f-4ef2-8443-77d697143dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:23.475265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:23.488967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1027/2046] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:23.492863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc70a5-ffb7-4342-ad99-213992790a12 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.506819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc70a5-ffb7-4342-ad99-213992790a12 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.515120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:23.516051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.516522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.516787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1020/2047] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:23.517107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.518103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:23.518647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:23.520769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:23.522306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dd002-c5d5-4eb6-8dee-8421bb70e831 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.524451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dd002-c5d5-4eb6-8dee-8421bb70e831 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.525778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5dd002-c5d5-4eb6-8dee-8421bb70e831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.558816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1028/2048] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:52:23.563201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.572698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9b5dd002-c5d5-4eb6-8dee-8421bb70e831 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:23.575143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9b5dd002-c5d5-4eb6-8dee-8421bb70e831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:23.584688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f369b-e141-47d7-95f2-4686a5232229 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.585747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1021/2049] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:23.590047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dd002-c5d5-4eb6-8dee-8421bb70e831 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.590636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:23.591368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.591661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.592164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.592914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:23.594906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:23.600876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5dd002-c5d5-4eb6-8dee-8421bb70e831 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.607088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:23.607767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.608053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.608331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.609359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:23.609674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:23.611530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:23.637801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1022/2050] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:23.642530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.644003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1029/2051] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:23.647042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.652898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:23.670167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09817f9-2f1c-48d9-876c-41ca36ca9e13 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.744588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ff1d72-0a01-4c55-8079-ae2e9064a493 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.753242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:23.754741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.754862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.755123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.756011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:23.758366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:23.759915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:23.760859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.761374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.761807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.762786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:23.766528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:23.790061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1030/2052] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:23.790598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.802870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9746b7-275f-4014-b120-6d2b988f3589 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.811142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:23.812363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:23.812893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:23.813434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:23.814406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:23.816724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:23.829375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1023/2053] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/projects => generated 383 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:23.836899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.853542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1031/2054] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:23.853542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:23.888908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1cb142-e381-4cfd-baa7-ef42d3bd63bc admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:23.985211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c9a6b-5d6d-45d0-8351-b8c3cb7dd245 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.003136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.004078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.004349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.004721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.005475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.013273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.017999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.020031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.020317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.022732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.023469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.027505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.057000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1024/2055] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:23 2022] POST /identity/v3/users => generated 292 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:24.061382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.068127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1032/2056] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:24.068127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.071663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.077811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4b7872-36f2-4b28-b2a1-5fc9530e6d35 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.083437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.084416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.085680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.085974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.086829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.088736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.096979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebbb710-52cd-4147-b5c5-c3f51efeaf47 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.102034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.102919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.103207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.103659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] PATH_INFO: `/v3/users/6c37e86a9abd4bc5905a999024c32f3f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.106939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c37e86a9abd4bc5905a999024c32f3f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.127097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.129003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1033/2057] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:24.133512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.152676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5426c4-3810-43ad-b6f9-543e2e9e5552 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.160008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.161186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.161552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.161905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] PATH_INFO: `/v3/projects/432e7ca909fb4ac1a2ae36931694b591/users/46339e67920a412c80c5998cf5f7b3ee/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.185815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] RBAC: Authorizing `identity:create_grant(project_id=432e7ca909fb4ac1a2ae36931694b591, user_id=46339e67920a412c80c5998cf5f7b3ee, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.189177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.210851 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1034/2058] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:24 2022] PUT /identity/v3/projects/432e7ca909fb4ac1a2ae36931694b591/users/46339e67920a412c80c5998cf5f7b3ee/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:24.212116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.218110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:24.221320 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c37e86a9abd4bc5905a999024c32f3f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.236699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c37e86a9abd4bc5905a999024c32f3f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.237578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c37e86a9abd4bc5905a999024c32f3f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.238855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c37e86a9abd4bc5905a999024c32f3f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.257003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c37e86a9abd4bc5905a999024c32f3f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.283709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1025/2059] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:24 2022] DELETE /identity/v3/users/6c37e86a9abd4bc5905a999024c32f3f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:24.285546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.287865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:24.288290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.310648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7051a41b-d996-449d-aa5e-071149f9934a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.386290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d70b269-469d-48fd-b2ae-8a5bb839ffb3 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.388158 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed2178-e88b-4dee-97c1-5156c3beb485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.391489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2178-e88b-4dee-97c1-5156c3beb485 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.391489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2178-e88b-4dee-97c1-5156c3beb485 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.391489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed2178-e88b-4dee-97c1-5156c3beb485 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.391489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed2178-e88b-4dee-97c1-5156c3beb485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.392526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed2178-e88b-4dee-97c1-5156c3beb485 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.393068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.394066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.394418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.394750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] PATH_INFO: `/v3/users/7031e43fdd0643299e9b9cb78cb2d266` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.398537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7031e43fdd0643299e9b9cb78cb2d266)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.398819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.411347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1035/2060] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:24.412978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.413254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.413536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.453091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] MFA Rules not processed for user `46339e67920a412c80c5998cf5f7b3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:24.454486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.468784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7031e43fdd0643299e9b9cb78cb2d266'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.477663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7031e43fdd0643299e9b9cb78cb2d266'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.478427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7031e43fdd0643299e9b9cb78cb2d266'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.479167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7031e43fdd0643299e9b9cb78cb2d266'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.498524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-187be741-a8ee-4655-8183-ccc2ca5a4c34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7031e43fdd0643299e9b9cb78cb2d266'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:24.515238 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1026/2061] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:24 2022] DELETE /identity/v3/users/7031e43fdd0643299e9b9cb78cb2d266 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:24.516785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7200-2e58-4a42-b32e-7d798956d1e3 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.517361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7200-2e58-4a42-b32e-7d798956d1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.517634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa7200-2e58-4a42-b32e-7d798956d1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.546055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e8aa7200-2e58-4a42-b32e-7d798956d1e3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:24.547282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e8aa7200-2e58-4a42-b32e-7d798956d1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.573821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1036/2062] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:24.574685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.590167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.593392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:24.614564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f0799-37e9-4476-b19e-80c446257ae4 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.626568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1027/2063] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:24.628755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.634576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.634919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.662851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:24.666245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.677014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1028/2064] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:24.678641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.680014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.703249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.704511 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.705356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.705726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] PATH_INFO: `/v3/projects/e88012f4a36946d28ba9b27effa56e00/users/a55a254afa8449a285bd6448792ec196/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.727018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88012f4a36946d28ba9b27effa56e00, user_id=a55a254afa8449a285bd6448792ec196, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.731131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.745333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:24.752775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1037/2065] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:24 2022] PUT /identity/v3/projects/e88012f4a36946d28ba9b27effa56e00/users/a55a254afa8449a285bd6448792ec196/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:24.754226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.756770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.774688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099d1cb7-c713-4c82-b2df-b1bee474431e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.829219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21abc7-a496-4aff-ae2f-faebf42051c1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.834122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.834861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.835218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.835647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.849386 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17514909-3929-4856-a3f6-8763d78d0adf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.850559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514909-3929-4856-a3f6-8763d78d0adf service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.850883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514909-3929-4856-a3f6-8763d78d0adf service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.851151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17514909-3929-4856-a3f6-8763d78d0adf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.907834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.909427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.917754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17514909-3929-4856-a3f6-8763d78d0adf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.919223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17514909-3929-4856-a3f6-8763d78d0adf service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.919622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1038/2066] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:24.925184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.927338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.928571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1029/2067] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:24.929849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c632-3fee-478c-8f8e-a0f386885138 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.930147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c632-3fee-478c-8f8e-a0f386885138 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.930428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776c632-3fee-478c-8f8e-a0f386885138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.960062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077403e-04b2-48e2-9118-c0aa2ebab22a service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:24.962437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0776c632-3fee-478c-8f8e-a0f386885138 None None] MFA Rules not processed for user `a55a254afa8449a285bd6448792ec196`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:24.965492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0776c632-3fee-478c-8f8e-a0f386885138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:24.966052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:24.966728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:24.967027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:24.967314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:24.980660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:24.982322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:24.995926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1039/2068] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:24.997036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:24.998580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.007037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:25.014232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81127ee9-f861-46d2-a368-ea58db5210db service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.020410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.021555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.021845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.022132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] PATH_INFO: `/v3/users/46339e67920a412c80c5998cf5f7b3ee` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.023429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46339e67920a412c80c5998cf5f7b3ee)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.026667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.048646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1030/2069] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:25.049953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c632-3fee-478c-8f8e-a0f386885138 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.064342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776c632-3fee-478c-8f8e-a0f386885138 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.069551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.070225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.070546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.070893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.071533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.074105 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.099230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46339e67920a412c80c5998cf5f7b3ee'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.125287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46339e67920a412c80c5998cf5f7b3ee'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.129130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1031/2070] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:25 2022] POST /identity/v3/projects => generated 383 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:25.135359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.161518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46339e67920a412c80c5998cf5f7b3ee'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.162271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46339e67920a412c80c5998cf5f7b3ee'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.190273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46339e67920a412c80c5998cf5f7b3ee'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.201960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1040/2071] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:24 2022] DELETE /identity/v3/users/46339e67920a412c80c5998cf5f7b3ee => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:25.202938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.204197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.214497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:25.269732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846abf46-f9b7-4b41-bfd2-a9129cfc8a6f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.329875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2b11a8-462f-49f0-92df-6a94c9ebdba6 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.334075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.334764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.335020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.335294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.337443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.420958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6210a6c-81f6-49b1-b393-c831e6a0f620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.422809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6210a6c-81f6-49b1-b393-c831e6a0f620 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.423103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6210a6c-81f6-49b1-b393-c831e6a0f620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.423954 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6210a6c-81f6-49b1-b393-c831e6a0f620 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.424765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6210a6c-81f6-49b1-b393-c831e6a0f620 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.427784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6210a6c-81f6-49b1-b393-c831e6a0f620 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.451357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.459076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.461089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1032/2072] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:25 2022] POST /identity/v3/users => generated 298 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:25.462697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.463073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.463360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.472483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1041/2073] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:25.475155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.476641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.487049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:25.488877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.493644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09475970-41c9-40ee-82c2-5e5b26ceb0b8 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.499557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.500457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.500750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.501035 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] PATH_INFO: `/v3/projects/7f76653418e74507a6546c87f864da20` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.501673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1033/2074] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:25.502676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f76653418e74507a6546c87f864da20)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.503084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.504638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.504940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.536930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2699449-9a5c-444a-abe9-71e84286e137 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.545726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.548078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.548478 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.548837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] PATH_INFO: `/v3/projects/52be45c82b024cc290e7710d971b22cf` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.550340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] RBAC: Authorizing `identity:delete_project(project_id=52be45c82b024cc290e7710d971b22cf)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.552906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.564188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f76653418e74507a6546c87f864da20', 'request_id': 'req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.574356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f76653418e74507a6546c87f864da20', 'request_id': 'req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.581905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f76653418e74507a6546c87f864da20', 'request_id': 'req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.595651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] The token cache is being invalidate because project 7f76653418e74507a6546c87f864da20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:25.596039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.596806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.598658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1042/2075] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:25 2022] DELETE /identity/v3/projects/7f76653418e74507a6546c87f864da20 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:25.599653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.600900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.619270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:25.630565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52be45c82b024cc290e7710d971b22cf', 'request_id': 'req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.639546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52be45c82b024cc290e7710d971b22cf', 'request_id': 'req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.648571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52be45c82b024cc290e7710d971b22cf', 'request_id': 'req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.661239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] The token cache is being invalidate because project 52be45c82b024cc290e7710d971b22cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:25.661559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.662230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.663132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:25.664222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1034/2076] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:25 2022] DELETE /identity/v3/projects/52be45c82b024cc290e7710d971b22cf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:25.665051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.666497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.699867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf56e2-ae0d-4b9d-a49a-761d83ca8565 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.735559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567e89a0-f9a9-4f2a-a4c1-6e36d09cc84a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.741043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.741784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.742177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.742536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.744531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.770334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.771479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.771819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.772138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.772912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.774554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.788349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1043/2077] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:25.789213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.792922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.805839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48005cd7-4b44-43ae-b394-a105f2537d50 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.811760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.812687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.812971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.813249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] PATH_INFO: `/v3/users/cb7b7be511e54164917d845288102edf` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.814453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb7b7be511e54164917d845288102edf)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.816373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.837348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.839524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.860805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1035/2078] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:25.862784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.869295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.892400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf8fbf5-e215-4695-ad47-54f18ca4a3b0 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:25.897138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb7b7be511e54164917d845288102edf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.901032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:25.903250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:25.903569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:25.904437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] PATH_INFO: `/v3/users/36996723465f47f9bf2b80c82d060216` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:25.905585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36996723465f47f9bf2b80c82d060216)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:25.907604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:25.908116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb7b7be511e54164917d845288102edf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.928792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb7b7be511e54164917d845288102edf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.929672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb7b7be511e54164917d845288102edf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.940692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb7b7be511e54164917d845288102edf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.952521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1044/2079] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:25 2022] DELETE /identity/v3/users/cb7b7be511e54164917d845288102edf => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:25.952521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:25.953323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:25.975060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36996723465f47f9bf2b80c82d060216'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.987367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36996723465f47f9bf2b80c82d060216'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.988669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36996723465f47f9bf2b80c82d060216'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:25.990361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36996723465f47f9bf2b80c82d060216'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.009998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36996723465f47f9bf2b80c82d060216'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.013246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:26.029095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:26.038873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1036/2080] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:25 2022] DELETE /identity/v3/users/36996723465f47f9bf2b80c82d060216 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:26.039111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17613682-b6a1-4cfe-b6c0-d3e5724c198f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:26.130222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:26.131368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.132008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.132295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] PATH_INFO: `/v3/projects/790ab13381054330a2f4a6c9b12f9d7c/users/b68d147698934739aefbcc43eb7b4252/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.154355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790ab13381054330a2f4a6c9b12f9d7c, user_id=b68d147698934739aefbcc43eb7b4252, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:26.157310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:26.174484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1045/2081] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:25 2022] PUT /identity/v3/projects/790ab13381054330a2f4a6c9b12f9d7c/users/b68d147698934739aefbcc43eb7b4252/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:26.178641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:26.180994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.204518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e559e-b992-47e1-a122-fc5f1df065b4 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:26.285266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f88f8-9286-4f60-b0a2-1e635ea8a297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:26.285955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f88f8-9286-4f60-b0a2-1e635ea8a297 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.286263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f88f8-9286-4f60-b0a2-1e635ea8a297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.286678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f88f8-9286-4f60-b0a2-1e635ea8a297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.287437 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f88f8-9286-4f60-b0a2-1e635ea8a297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:26.289163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f88f8-9286-4f60-b0a2-1e635ea8a297 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:26.301068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1037/2082] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:26.305477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:26.317215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbfb1f7-19c6-461e-b8c3-ae67550e5633 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:26.322260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:26.324031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.324364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.324699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] PATH_INFO: `/v3/projects/790ab13381054330a2f4a6c9b12f9d7c/users/b68d147698934739aefbcc43eb7b4252/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.326812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=790ab13381054330a2f4a6c9b12f9d7c, user_id=b68d147698934739aefbcc43eb7b4252, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:26.329740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:26.345342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1046/2083] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:26 2022] PUT /identity/v3/projects/790ab13381054330a2f4a6c9b12f9d7c/users/b68d147698934739aefbcc43eb7b4252/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:26.359700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.360156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.360664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.388250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:26.392208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.405527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] MFA Rules not processed for user `b68d147698934739aefbcc43eb7b4252`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:26.406836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.501893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1038/2084] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:26.503208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:26.503783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b2055-e9f2-4c65-a8bd-858f8b0362d3 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:26.505394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.518007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:26.520788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.521171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.521728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] PATH_INFO: `/v3/projects/3bc57e01cc14484fa48b46377d3ef38f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.524823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701906-3c94-4f09-acb5-1c8808e574b4 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:26.525264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bc57e01cc14484fa48b46377d3ef38f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:26.528537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:26.534775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:26.535724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.536205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.536535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] PATH_INFO: `/v3/projects/432e7ca909fb4ac1a2ae36931694b591` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.538028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=432e7ca909fb4ac1a2ae36931694b591)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:26.540240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:26.585188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bc57e01cc14484fa48b46377d3ef38f', 'request_id': 'req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.593465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '432e7ca909fb4ac1a2ae36931694b591', 'request_id': 'req-cefe31e3-088f-4163-a943-380b8af75f2f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.593684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bc57e01cc14484fa48b46377d3ef38f', 'request_id': 'req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.599439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bc57e01cc14484fa48b46377d3ef38f', 'request_id': 'req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.600089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '432e7ca909fb4ac1a2ae36931694b591', 'request_id': 'req-cefe31e3-088f-4163-a943-380b8af75f2f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.608175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '432e7ca909fb4ac1a2ae36931694b591', 'request_id': 'req-cefe31e3-088f-4163-a943-380b8af75f2f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.612470 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] The token cache is being invalidate because project 3bc57e01cc14484fa48b46377d3ef38f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:26.612773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.613457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.614472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:26.615033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1047/2085] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:26 2022] DELETE /identity/v3/projects/3bc57e01cc14484fa48b46377d3ef38f => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:26.617219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:26.618781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.625875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] The token cache is being invalidate because project 432e7ca909fb4ac1a2ae36931694b591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:26.626337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.626821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:26.627628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.629451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1039/2086] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:26 2022] DELETE /identity/v3/projects/432e7ca909fb4ac1a2ae36931694b591 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:26.630342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:26.631837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.698553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2903ad1-462f-48ee-b5a2-fa9afbc8292d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:26.710406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefe31e3-088f-4163-a943-380b8af75f2f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:26.717605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:26.718487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.718779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.719061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] PATH_INFO: `/v3/projects/6d3b8b29a8f741559da069df278f11c6` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.720294 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d3b8b29a8f741559da069df278f11c6)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:26.724763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:26.756438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c43d5c-31ab-4840-ba2e-fe5db2651308 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:26.757441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43d5c-31ab-4840-ba2e-fe5db2651308 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.757638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43d5c-31ab-4840-ba2e-fe5db2651308 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.757918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c43d5c-31ab-4840-ba2e-fe5db2651308 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.759834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c6c43d5c-31ab-4840-ba2e-fe5db2651308 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.783302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3b8b29a8f741559da069df278f11c6', 'request_id': 'req-880ff768-af20-4b36-9034-2ba48edc02cf'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.790239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3b8b29a8f741559da069df278f11c6', 'request_id': 'req-880ff768-af20-4b36-9034-2ba48edc02cf'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.800438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3b8b29a8f741559da069df278f11c6', 'request_id': 'req-880ff768-af20-4b36-9034-2ba48edc02cf'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.811951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] The token cache is being invalidate because project 6d3b8b29a8f741559da069df278f11c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:26.812254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.812954 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-880ff768-af20-4b36-9034-2ba48edc02cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:26.814527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1040/2087] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:26 2022] DELETE /identity/v3/projects/6d3b8b29a8f741559da069df278f11c6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:26.815750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c29ca-810f-4a33-b313-4e50725b1518 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.816039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c29ca-810f-4a33-b313-4e50725b1518 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.816321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c29ca-810f-4a33-b313-4e50725b1518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.831923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c43d5c-31ab-4840-ba2e-fe5db2651308 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:26.833437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c43d5c-31ab-4840-ba2e-fe5db2651308 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:26.835653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-090c29ca-810f-4a33-b313-4e50725b1518 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:26.839464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-090c29ca-810f-4a33-b313-4e50725b1518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.845495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1048/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:26.847275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e834-31b5-4dd0-80dc-46bac6db50d0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.847719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e834-31b5-4dd0-80dc-46bac6db50d0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.848177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4858e834-31b5-4dd0-80dc-46bac6db50d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.874218 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4858e834-31b5-4dd0-80dc-46bac6db50d0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:26.875843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4858e834-31b5-4dd0-80dc-46bac6db50d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.939789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1041/2089] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:26.942070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.942374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.942664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.954752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1049/2090] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:26.954752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece8e3-e684-4d13-a7b1-838ddf5a37e0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.954752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece8e3-e684-4d13-a7b1-838ddf5a37e0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.954752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece8e3-e684-4d13-a7b1-838ddf5a37e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.971354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5aece8e3-e684-4d13-a7b1-838ddf5a37e0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:26.972613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5aece8e3-e684-4d13-a7b1-838ddf5a37e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.986025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1050/2091] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:26.986200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:26.986297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb76f1-bdfc-443f-a2d5-148b5cc67ac1 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:26.986297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb76f1-bdfc-443f-a2d5-148b5cc67ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:26.986452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:26.986555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb76f1-bdfc-443f-a2d5-148b5cc67ac1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:26.991696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:26.996023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1042/2092] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:26.997132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:26.998508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:27.006392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-14fb76f1-bdfc-443f-a2d5-148b5cc67ac1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:27.007969 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-14fb76f1-bdfc-443f-a2d5-148b5cc67ac1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:27.021388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1051/2093] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:27.021388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb76f1-bdfc-443f-a2d5-148b5cc67ac1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.022488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:27.033805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb76f1-bdfc-443f-a2d5-148b5cc67ac1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.041398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd48ef0e-0ab4-4cab-9f64-d909635b0731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.042600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ef0e-0ab4-4cab-9f64-d909635b0731 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.042890 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ef0e-0ab4-4cab-9f64-d909635b0731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.043238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd48ef0e-0ab4-4cab-9f64-d909635b0731 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.044057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48ef0e-0ab4-4cab-9f64-d909635b0731 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:27.044391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48ef0e-0ab4-4cab-9f64-d909635b0731 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.046035 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd48ef0e-0ab4-4cab-9f64-d909635b0731 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.065465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1052/2094] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:27.065465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b806-f898-4ba0-8dcf-55d85c20a098 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.065465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b806-f898-4ba0-8dcf-55d85c20a098 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.065465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234b806-f898-4ba0-8dcf-55d85c20a098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.071283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465d1a78-e168-42df-af5e-d2791a15ccdb None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.076881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.077778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.078224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.078754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.083192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6234b806-f898-4ba0-8dcf-55d85c20a098 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:27.083739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:27.084434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6234b806-f898-4ba0-8dcf-55d85c20a098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:27.093595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1053/2095] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:27.095173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234b806-f898-4ba0-8dcf-55d85c20a098 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.108717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234b806-f898-4ba0-8dcf-55d85c20a098 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.114211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.114886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.115318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.115572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.116474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:27.116790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.118858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.138032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1054/2096] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:27.138032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.149660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55fa9f-c2c6-4e7d-a469-474e52102bfd admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.156693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.157927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.158392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.159332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.160642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.163944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.173463 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.174970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.186204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1043/2097] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:27.187131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.204676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcb70d-bddd-4e13-a3f9-31d3f72fd3d3 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.212072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.212975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.213563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1055/2098] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:27.213998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.214543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.214681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.215585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:27.215908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.217682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.234024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1044/2099] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:27.234864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.247561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0a8c1a-3a4a-422f-a074-8d2c94394746 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.306517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9afee2-5f5a-4f05-875e-ba5bbd856912 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.314530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.315492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.315926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.316363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.317298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.319680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.355361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1056/2100] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/projects => generated 375 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:27.355361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.356641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.357255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.357733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.358208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.359175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.361400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.387575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1045/2101] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:27.388549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.400155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd41d36b-656c-4eae-bf14-348012ac8132 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.447120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93f5bc0-5343-44e7-b983-56f6f0f1aff0 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.453068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.453997 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.454117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.454350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.455335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.457182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.460501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:27.477377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.478149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.478467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.478730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.479584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.481561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.502489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1057/2102] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:27.502489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.517419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1046/2103] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:27.518407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.530394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:27.532149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28e30e4-5f30-4672-9a84-6d2dd5664001 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.600104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c707b-0bf6-43a6-b9b6-929fa84fda6e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.607030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.607725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.608045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.608330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.608855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.609119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.609811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.610206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.610576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.611701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.611824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.614128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.627949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1058/2104] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:27.629732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.647354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1047/2105] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/users => generated 292 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:27.647497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a070de43-0918-4771-bf3b-8e3a825cb806 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.650422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.654018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.654846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.655197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.655580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.656431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.658157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.662130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e46a52e-82b6-4f63-9f4b-4b722e02ed49 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.667627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.668433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.668717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.668999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.672612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1059/2106] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:27.672765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.672859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.672945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.681669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09cc607-b56e-481b-a443-eb61fe2dc45c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.687134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1048/2107] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:27.687134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.689034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.689758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.689988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.690416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.690987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.692604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.695651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ee4f85-5925-449f-a4b4-aee3bba3f8d1 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.701496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.702195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.702486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.702772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.703512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.704492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1060/2108] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:27.705163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.705366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.715482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bf626-f123-43b0-a8e0-d41fff2df47b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.716201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1049/2109] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:27.717005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.722446 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.723554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.724564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.725061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] PATH_INFO: `/v3/projects/187ed1427fba4a5dbd5b804ff99a5a79/users/f6325c2f32bb4539b61d4edf1f979813/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.730506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aadf403-39f3-4ae4-8f19-57bc5f4dc5d2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.735032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.735701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.736054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.736332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.737106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.738699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.741904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=187ed1427fba4a5dbd5b804ff99a5a79, user_id=f6325c2f32bb4539b61d4edf1f979813, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.744587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.753919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1050/2110] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:27.754793 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.762763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1061/2111] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:27 2022] PUT /identity/v3/projects/187ed1427fba4a5dbd5b804ff99a5a79/users/f6325c2f32bb4539b61d4edf1f979813/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:27.765517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3809fcb-bc2d-48f1-a596-7351ac5b4bc5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.769372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.824878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88c2fc-e2ff-4f96-9384-50fd2b4828d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.825797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c2fc-e2ff-4f96-9384-50fd2b4828d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.826079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c2fc-e2ff-4f96-9384-50fd2b4828d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.826445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88c2fc-e2ff-4f96-9384-50fd2b4828d1 admin admin] PATH_INFO: `/v3/projects/33e275a499784fd99f84c153a152d158/users/ff2fb56d06f9428c8e0b4b1f7ec484a1/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.836050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d79f9f-c601-4e12-aebc-f884aca80b48 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:27.841808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e0c019-9817-4b10-8d97-62881ca712f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:27.842717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0c019-9817-4b10-8d97-62881ca712f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.843002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0c019-9817-4b10-8d97-62881ca712f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.843284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e0c019-9817-4b10-8d97-62881ca712f9 admin admin] PATH_INFO: `/v3/projects/8a33c755d13949fd884164aee4be26fb/users/fb9cb0f70ec445d09f8fd6f32a8ace87/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.845376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88c2fc-e2ff-4f96-9384-50fd2b4828d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33e275a499784fd99f84c153a152d158, user_id=ff2fb56d06f9428c8e0b4b1f7ec484a1, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.849174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88c2fc-e2ff-4f96-9384-50fd2b4828d1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.861100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0c019-9817-4b10-8d97-62881ca712f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a33c755d13949fd884164aee4be26fb, user_id=fb9cb0f70ec445d09f8fd6f32a8ace87, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:27.863829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e0c019-9817-4b10-8d97-62881ca712f9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:27.864744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1051/2112] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:27 2022] PUT /identity/v3/projects/33e275a499784fd99f84c153a152d158/users/ff2fb56d06f9428c8e0b4b1f7ec484a1/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:27.866110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53dab8-f1ee-423d-9d57-24eb520163ff None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.866413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53dab8-f1ee-423d-9d57-24eb520163ff None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.866694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53dab8-f1ee-423d-9d57-24eb520163ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.885090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1062/2113] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:27 2022] PUT /identity/v3/projects/8a33c755d13949fd884164aee4be26fb/users/fb9cb0f70ec445d09f8fd6f32a8ace87/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:27.887037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ed90-bae4-40ac-883b-67248dc15742 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.887380 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ed90-bae4-40ac-883b-67248dc15742 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.888476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b4ed90-bae4-40ac-883b-67248dc15742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.897361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1f53dab8-f1ee-423d-9d57-24eb520163ff None None] MFA Rules not processed for user `f6325c2f32bb4539b61d4edf1f979813`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:27.898604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1f53dab8-f1ee-423d-9d57-24eb520163ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:27.905796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:27.918350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-19b4ed90-bae4-40ac-883b-67248dc15742 None None] MFA Rules not processed for user `ff2fb56d06f9428c8e0b4b1f7ec484a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:27.920003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-19b4ed90-bae4-40ac-883b-67248dc15742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:27.953049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:27.968292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1052/2114] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:27.970061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9311d-f3e7-4986-9057-a50064735839 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:27.970356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9311d-f3e7-4986-9057-a50064735839 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:27.970641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f9311d-f3e7-4986-9057-a50064735839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:27.993559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1063/2115] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:27.998433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ed90-bae4-40ac-883b-67248dc15742 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:27.999357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-11f9311d-f3e7-4986-9057-a50064735839 None None] MFA Rules not processed for user `fb9cb0f70ec445d09f8fd6f32a8ace87`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:28.000611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-11f9311d-f3e7-4986-9057-a50064735839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:28.054146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b4ed90-bae4-40ac-883b-67248dc15742 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.057922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.058536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.058817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.059166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.068497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.069962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.070601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1053/2116] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:28.071565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9311d-f3e7-4986-9057-a50064735839 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.080414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1064/2117] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:28.084622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.086608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:28.099709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8974041a-47b9-4fee-b273-aad51f0c0627 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.103514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.104163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.105773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.106074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.114783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.116154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.126706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1065/2118] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:28.152841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f9311d-f3e7-4986-9057-a50064735839 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.158161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.158845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.159134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.159416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.160139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.162092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.198217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1054/2119] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:28 2022] POST /identity/v3/projects => generated 375 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:28.202116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.216929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e432067-16e1-4832-bffb-05a0e6b15594 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.302586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.303554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.303978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.304364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.305211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.307919 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.342639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1066/2120] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:28 2022] POST /identity/v3/users => generated 288 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:28.346722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.358322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb18ac2-69bf-47d1-9a61-9864bf4f2ff5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.363887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.364754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.365104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.365389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.366131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.367770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.381593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1055/2121] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:28.386010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.397808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1890de2-cff6-47a2-9d83-2932e8d49c96 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.404771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819e5654-e3c7-4cab-92fd-d0981e7eb6e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.405642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5654-e3c7-4cab-92fd-d0981e7eb6e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.405995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5654-e3c7-4cab-92fd-d0981e7eb6e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.406365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819e5654-e3c7-4cab-92fd-d0981e7eb6e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.407829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e5654-e3c7-4cab-92fd-d0981e7eb6e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.409678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819e5654-e3c7-4cab-92fd-d0981e7eb6e7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.434497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1067/2122] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:28.438957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.465166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb500eb-9125-4684-b82b-da9b69ec3c35 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.475237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.476403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.477332 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.477704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] PATH_INFO: `/v3/projects/65bdd047c5ce43209d0efb68d71dddde/users/d6e8d5a157e8495db46e36a01fc30c40/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.492573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:28.515646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] RBAC: Authorizing `identity:create_grant(project_id=65bdd047c5ce43209d0efb68d71dddde, user_id=d6e8d5a157e8495db46e36a01fc30c40, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.519214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.539556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1056/2123] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:28 2022] PUT /identity/v3/projects/65bdd047c5ce43209d0efb68d71dddde/users/d6e8d5a157e8495db46e36a01fc30c40/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:28.550284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7390e-dd99-4a8e-b7d1-5e14042ca8ee None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.550596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7390e-dd99-4a8e-b7d1-5e14042ca8ee None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.550921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf7390e-dd99-4a8e-b7d1-5e14042ca8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.596274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7cf7390e-dd99-4a8e-b7d1-5e14042ca8ee None None] MFA Rules not processed for user `d6e8d5a157e8495db46e36a01fc30c40`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:28.597962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7cf7390e-dd99-4a8e-b7d1-5e14042ca8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:28.654737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:28.708397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1068/2124] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:28.709560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.796785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d517241-821d-4ee8-8df4-39df19cc481c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.805190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.806014 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.806303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.806585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.807326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.809750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.840339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1057/2125] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:28 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:28.841483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7390e-dd99-4a8e-b7d1-5e14042ca8ee None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.852487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf7390e-dd99-4a8e-b7d1-5e14042ca8ee None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.912075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.912847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.913139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.913448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.914142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.916071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.936231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1069/2126] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:28 2022] POST /identity/v3/users => generated 295 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:28.940264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.950941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325f96a-c8f0-438b-9376-f2458d61eb41 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.955804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.956569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.956856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.957138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:28.957895 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:28.959503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:28.971877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1058/2127] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:28.976065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:28.986869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cdd9c-e3c7-43cd-81f0-9835014bef08 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:28.991573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:28.992606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:28.992896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:28.993179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] PATH_INFO: `/v3/projects/167a934f919f48f9b606070f8fece106/users/68fa17e12d1740b697be33a7f4b1fa60/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:29.009461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167a934f919f48f9b606070f8fece106, user_id=68fa17e12d1740b697be33a7f4b1fa60, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:29.012736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:29.027917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1070/2128] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:28 2022] PUT /identity/v3/projects/167a934f919f48f9b606070f8fece106/users/68fa17e12d1740b697be33a7f4b1fa60/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:29.032023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:29.042499 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4982967c-ef5e-4669-957e-71fc38c0ad6a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:29.107293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ba966b-02db-4c86-9837-3809f4f13d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:29.108106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba966b-02db-4c86-9837-3809f4f13d1d admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:29.108106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba966b-02db-4c86-9837-3809f4f13d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:29.108423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ba966b-02db-4c86-9837-3809f4f13d1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:29.109166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba966b-02db-4c86-9837-3809f4f13d1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:29.110871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ba966b-02db-4c86-9837-3809f4f13d1d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:29.124582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1059/2129] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:29.129188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:29.140951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88cd8d6-2627-4228-bbbd-5d5c59bd5809 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:29.146099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:29.146975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:29.147258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:29.147536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] PATH_INFO: `/v3/projects/167a934f919f48f9b606070f8fece106/users/68fa17e12d1740b697be33a7f4b1fa60/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:29.149686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167a934f919f48f9b606070f8fece106, user_id=68fa17e12d1740b697be33a7f4b1fa60, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:29.153667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:29.165685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1071/2130] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:29 2022] PUT /identity/v3/projects/167a934f919f48f9b606070f8fece106/users/68fa17e12d1740b697be33a7f4b1fa60/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:29.177049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:29.177352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:29.177642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:29.204232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] MFA Rules not processed for user `68fa17e12d1740b697be33a7f4b1fa60`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:29.205488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:29.250207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:29.278169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1060/2131] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:29 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:29.289548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:29.347908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac76f259-fd27-432b-8f19-4c1cb5f89178 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:29.351604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831e964f-d996-4056-b3fd-63c95b920d70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:29.352283 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e964f-d996-4056-b3fd-63c95b920d70 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:29.352601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e964f-d996-4056-b3fd-63c95b920d70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:29.352885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831e964f-d996-4056-b3fd-63c95b920d70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:29.395871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:29.419032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e964f-d996-4056-b3fd-63c95b920d70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:29.421491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831e964f-d996-4056-b3fd-63c95b920d70 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:29.436361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1072/2132] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:30.051935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:30.053504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:30.143485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e009-e75d-4e6b-b6f7-26878b956e3b None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:30.148228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:30.149126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:30.149409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:30.149694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] PATH_INFO: `/v3/users/a55a254afa8449a285bd6448792ec196` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:30.150872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a55a254afa8449a285bd6448792ec196)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:30.153085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:30.201938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a55a254afa8449a285bd6448792ec196'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.209685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a55a254afa8449a285bd6448792ec196'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.210307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a55a254afa8449a285bd6448792ec196'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.210953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a55a254afa8449a285bd6448792ec196'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.224077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a55a254afa8449a285bd6448792ec196'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.238304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1061/2133] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:30 2022] DELETE /identity/v3/users/a55a254afa8449a285bd6448792ec196 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:30.243181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:30.243682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:30.243924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:30.262030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:30.263381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:30.329239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1073/2134] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:30.342103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:30.344699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:30.406615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df083669-27d7-42c5-ba16-093ff87bef3c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:30.412185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:30.413054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:30.413351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:30.413638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:30.425673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:30.427243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:30.438867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1062/2135] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:30.762668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:30.764564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:30.782943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c72a0c-e608-426d-8e7a-42dc314dded0 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:30.792745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:30.794474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:30.795147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:30.795670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] PATH_INFO: `/v3/projects/e88012f4a36946d28ba9b27effa56e00` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:30.798643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88012f4a36946d28ba9b27effa56e00)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:30.800607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:30.910231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88012f4a36946d28ba9b27effa56e00', 'request_id': 'req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.922029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88012f4a36946d28ba9b27effa56e00', 'request_id': 'req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.928361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88012f4a36946d28ba9b27effa56e00', 'request_id': 'req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.942387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] The token cache is being invalidate because project e88012f4a36946d28ba9b27effa56e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:30.942691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.943382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:30.944974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1074/2136] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:30 2022] DELETE /identity/v3/projects/e88012f4a36946d28ba9b27effa56e00 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:30.949809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:30.956232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:30.960837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c739b3d-668d-4de2-9b3a-450d9af45364 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:31.033415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:31.034592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.034913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.035206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] PATH_INFO: `/v3/users/b68d147698934739aefbcc43eb7b4252` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.036513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b68d147698934739aefbcc43eb7b4252)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:31.038584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:31.050996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:31.052597 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.092202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b68d147698934739aefbcc43eb7b4252'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.106991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b68d147698934739aefbcc43eb7b4252'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.107956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b68d147698934739aefbcc43eb7b4252'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.108820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b68d147698934739aefbcc43eb7b4252'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.126368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b68d147698934739aefbcc43eb7b4252'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.127239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b08b9-c330-43dd-b7d7-51f74f7b77e1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:31.131368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d86635-4562-4f36-9295-13651e9f1ebb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:31.132052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d86635-4562-4f36-9295-13651e9f1ebb service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.132340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d86635-4562-4f36-9295-13651e9f1ebb service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.132702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d86635-4562-4f36-9295-13651e9f1ebb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.134610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-46d86635-4562-4f36-9295-13651e9f1ebb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.141449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1063/2137] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:30 2022] DELETE /identity/v3/users/b68d147698934739aefbcc43eb7b4252 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:31.158535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:31.211547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:31.214428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.242345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d86635-4562-4f36-9295-13651e9f1ebb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:31.245369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d86635-4562-4f36-9295-13651e9f1ebb service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:31.257854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1075/2138] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:31.329671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b8b6-4d00-42cb-90da-1876933411a5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:31.335648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:31.336663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.336894 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.337818 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] PATH_INFO: `/v3/users/977b6977aa0241a0984fd247976b094e` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.341187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=977b6977aa0241a0984fd247976b094e)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:31.358147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:31.401976 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:31.442286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '977b6977aa0241a0984fd247976b094e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.454466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '977b6977aa0241a0984fd247976b094e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.457664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '977b6977aa0241a0984fd247976b094e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.459308 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '977b6977aa0241a0984fd247976b094e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.496476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '977b6977aa0241a0984fd247976b094e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.512903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1064/2139] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:31 2022] DELETE /identity/v3/users/977b6977aa0241a0984fd247976b094e => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:31.517609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.518263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.518740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.533196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:31.538954 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.545160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:31.546777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.637054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c884798e-d284-431c-ae37-dc2ae3fe73fc admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:31.642674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:31.643439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.643803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.644154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] PATH_INFO: `/v3/projects/790ab13381054330a2f4a6c9b12f9d7c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.645893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=790ab13381054330a2f4a6c9b12f9d7c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:31.648132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:31.654548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1076/2140] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:31.681194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:31.684056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.727651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '790ab13381054330a2f4a6c9b12f9d7c', 'request_id': 'req-f71b9f58-103e-4aeb-8c36-381d432a38ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.736263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '790ab13381054330a2f4a6c9b12f9d7c', 'request_id': 'req-f71b9f58-103e-4aeb-8c36-381d432a38ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.754854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '790ab13381054330a2f4a6c9b12f9d7c', 'request_id': 'req-f71b9f58-103e-4aeb-8c36-381d432a38ed'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.765328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbfcd69-1239-40d7-ba57-0e61c1c1ed40 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:31.774629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] The token cache is being invalidate because project 790ab13381054330a2f4a6c9b12f9d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:31.775024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.775812 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f71b9f58-103e-4aeb-8c36-381d432a38ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:31.780593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1065/2141] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:31 2022] DELETE /identity/v3/projects/790ab13381054330a2f4a6c9b12f9d7c => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:31.783821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cb4c0-936f-4804-88b5-66a4e1d76e63 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.785590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cb4c0-936f-4804-88b5-66a4e1d76e63 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.785913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0cb4c0-936f-4804-88b5-66a4e1d76e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.815480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-8e0cb4c0-936f-4804-88b5-66a4e1d76e63 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:31.817654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8e0cb4c0-936f-4804-88b5-66a4e1d76e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.853503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:31.856131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.856704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.857680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.859193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:31.864152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.909699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1066/2142] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:31.918386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:31.918584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b9bc5-37b8-4b21-8aef-791086535ea8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.918980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b9bc5-37b8-4b21-8aef-791086535ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.919344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349b9bc5-37b8-4b21-8aef-791086535ea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.941874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-349b9bc5-37b8-4b21-8aef-791086535ea8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:31.944253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-349b9bc5-37b8-4b21-8aef-791086535ea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:31.959420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1067/2143] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:31.966455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b9bc5-37b8-4b21-8aef-791086535ea8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:31.977001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349b9bc5-37b8-4b21-8aef-791086535ea8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:31.982875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:31.983091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:31.983664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:31.983954 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:31.984236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:31.984409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:31.985026 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:31.985339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:31.986940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:31.998935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1077/2144] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:32.002986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1068/2145] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:32.006849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.025664 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb8124-ccde-435f-af6f-9a064cc56483 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.034315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.035328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.035792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.036462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.037098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.039907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.091225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1078/2146] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:32 2022] POST /identity/v3/projects => generated 387 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:32.095361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.130381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00a2fa-79eb-4f02-922a-238054af3ec3 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.173321 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.175208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:32.242112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.244482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.245359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.248896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.251331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.256129 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.288927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ea459-cc62-420e-8b78-21def5283fcd admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.290235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1069/2147] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:32 2022] POST /identity/v3/users => generated 294 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:32.294443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.295980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.296762 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.297117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.297469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.299473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:32.307256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a484202-8a14-46bf-9ff1-6d9c01968192 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.314517 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.315570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.315685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.316018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.317492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.319263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.334509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1070/2148] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:32.339345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.353695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493fb4f-b40c-4080-9678-ff2931e440c5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.360104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.360859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.361154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.361542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.362205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.363860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.376749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.377150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1071/2149] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:32.378892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.381949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.392100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1079/2150] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:32.399860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf26c3c-eb1c-4f34-b783-f04a8635e3e6 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.409549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4cad01-bf9d-4257-8793-c118b4461a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.409834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.410457 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cad01-bf9d-4257-8793-c118b4461a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.410773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cad01-bf9d-4257-8793-c118b4461a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.411037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4cad01-bf9d-4257-8793-c118b4461a15 admin admin] PATH_INFO: `/v3/projects/734c386934f240d3b9af55440b06aae7/users/7c231b4be02c43f39bd5e7152b641458/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.411386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:32.431824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cad01-bf9d-4257-8793-c118b4461a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=734c386934f240d3b9af55440b06aae7, user_id=7c231b4be02c43f39bd5e7152b641458, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.436492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4cad01-bf9d-4257-8793-c118b4461a15 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.439533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc13c462-7f1f-4e85-b994-5a9e8f83b5eb service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.446343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.447550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.448214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.448490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] PATH_INFO: `/v3/projects/5df20ff5c5fe468f948bf6e392aa502f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.450607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5df20ff5c5fe468f948bf6e392aa502f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.453088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.458821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1072/2151] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:32 2022] PUT /identity/v3/projects/734c386934f240d3b9af55440b06aae7/users/7c231b4be02c43f39bd5e7152b641458/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:32.469979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.470410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.470810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.506078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] MFA Rules not processed for user `7c231b4be02c43f39bd5e7152b641458`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:32.507287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:32.517932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:32.523165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5df20ff5c5fe468f948bf6e392aa502f', 'request_id': 'req-7636ddf4-22a1-44fd-ad02-834f2beaaa46'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.533500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5df20ff5c5fe468f948bf6e392aa502f', 'request_id': 'req-7636ddf4-22a1-44fd-ad02-834f2beaaa46'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.540147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5df20ff5c5fe468f948bf6e392aa502f', 'request_id': 'req-7636ddf4-22a1-44fd-ad02-834f2beaaa46'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.555396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] The token cache is being invalidate because project 5df20ff5c5fe468f948bf6e392aa502f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:32.555697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.557665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.561977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1080/2152] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:32 2022] DELETE /identity/v3/projects/5df20ff5c5fe468f948bf6e392aa502f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:32.563285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.565007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:32.571883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:32.595073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1073/2153] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:32.599554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.600926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:32.638956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636ddf4-22a1-44fd-ad02-834f2beaaa46 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.643990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.644908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.645200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.645740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] PATH_INFO: `/v3/users/d66a8ccf6e2a49eaa01c907e90cfe4ed` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.646978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d66a8ccf6e2a49eaa01c907e90cfe4ed)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.649024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.671967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cae0800-bc08-4e36-a4f1-db1e58050f4a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.676737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.677407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.677704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.677990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.678704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.680988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.709817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd66a8ccf6e2a49eaa01c907e90cfe4ed'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.710622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1074/2154] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:32 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:32.715067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.717789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd66a8ccf6e2a49eaa01c907e90cfe4ed'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.731742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd66a8ccf6e2a49eaa01c907e90cfe4ed'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.732491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd66a8ccf6e2a49eaa01c907e90cfe4ed'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.748859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd66a8ccf6e2a49eaa01c907e90cfe4ed'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:32.756744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1081/2155] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:32 2022] DELETE /identity/v3/users/d66a8ccf6e2a49eaa01c907e90cfe4ed => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:32.790623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc886d-33cd-4f04-974e-67d696a34c40 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.851190 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.851872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.852166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.852558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.853277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.856134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.876775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1075/2156] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:32 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:32.880594 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.882155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:32.897293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df90ae9-3e2d-4077-9f6b-a26850f517e7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.902320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.902987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.903277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.903556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.904285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.905932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.917611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1082/2157] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:32.921929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.933121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058cf582-d776-4e48-922e-70cbe5b78745 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:32.937990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:32.938918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:32.939211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:32.939505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] PATH_INFO: `/v3/projects/30f402661299423793ddac93ee413716/users/97dce6f14ab042dca0df40c1c79cffef/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:32.943763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:32.960917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f402661299423793ddac93ee413716, user_id=97dce6f14ab042dca0df40c1c79cffef, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:32.964162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:32.978151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1076/2158] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:32 2022] PUT /identity/v3/projects/30f402661299423793ddac93ee413716/users/97dce6f14ab042dca0df40c1c79cffef/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:32.986443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:32.997766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33978d79-5342-42b6-94ba-e1d08436bac2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.044494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:33.055870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.057829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.071239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.071952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.072239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.072553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.073879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.075916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.087561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1083/2159] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:33.091761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.102592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdb9e5d-76c1-4561-a7b2-2d556c6c9414 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.107702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497954f8-a542-42eb-b0dc-ba6b9831b4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.108939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497954f8-a542-42eb-b0dc-ba6b9831b4e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.108939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497954f8-a542-42eb-b0dc-ba6b9831b4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.109773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497954f8-a542-42eb-b0dc-ba6b9831b4e9 admin admin] PATH_INFO: `/v3/projects/30f402661299423793ddac93ee413716/users/97dce6f14ab042dca0df40c1c79cffef/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.111787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497954f8-a542-42eb-b0dc-ba6b9831b4e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30f402661299423793ddac93ee413716, user_id=97dce6f14ab042dca0df40c1c79cffef, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.114520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497954f8-a542-42eb-b0dc-ba6b9831b4e9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.126451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1084/2160] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:33 2022] PUT /identity/v3/projects/30f402661299423793ddac93ee413716/users/97dce6f14ab042dca0df40c1c79cffef/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:33.130088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d6741-21d6-4ef8-95e3-34e359513fb7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.139083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.139627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.140449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.174900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] MFA Rules not processed for user `97dce6f14ab042dca0df40c1c79cffef`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:33.176147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.195698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.196775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.197226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.197560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] PATH_INFO: `/v3/projects/2ab0d363fbe746c5a05266ed1466abc9` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.199958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab0d363fbe746c5a05266ed1466abc9)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.202025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.256095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1085/2161] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:33.273981 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.277000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.277460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab0d363fbe746c5a05266ed1466abc9', 'request_id': 'req-09e30a19-bf87-44b6-ba49-b31b7014f1a9'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.287106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab0d363fbe746c5a05266ed1466abc9', 'request_id': 'req-09e30a19-bf87-44b6-ba49-b31b7014f1a9'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.298125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab0d363fbe746c5a05266ed1466abc9', 'request_id': 'req-09e30a19-bf87-44b6-ba49-b31b7014f1a9'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.314785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] The token cache is being invalidate because project 2ab0d363fbe746c5a05266ed1466abc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:33.315516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.316260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09e30a19-bf87-44b6-ba49-b31b7014f1a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.320006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1077/2162] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:33 2022] DELETE /identity/v3/projects/2ab0d363fbe746c5a05266ed1466abc9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:33.326583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e06e8-b300-4cf5-aa08-9626f3d2cb48 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.327081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e06e8-b300-4cf5-aa08-9626f3d2cb48 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.327340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2e06e8-b300-4cf5-aa08-9626f3d2cb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.341263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68ef09-52f7-44b4-8a89-323ceb1d5189 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.352359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ab2e06e8-b300-4cf5-aa08-9626f3d2cb48 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:33.354236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ab2e06e8-b300-4cf5-aa08-9626f3d2cb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.381210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:33.399685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.400356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.400681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.401486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.404039 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.431856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:33.444513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1078/2163] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:33.453074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab6a7-0cb3-4268-9d98-8fa0f58828cf None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.453695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab6a7-0cb3-4268-9d98-8fa0f58828cf None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.454490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04ab6a7-0cb3-4268-9d98-8fa0f58828cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.477355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e04ab6a7-0cb3-4268-9d98-8fa0f58828cf None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:33.477355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e04ab6a7-0cb3-4268-9d98-8fa0f58828cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.483312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.485010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.486584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1079/2164] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:33.490689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ab6a7-0cb3-4268-9d98-8fa0f58828cf None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.497046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1086/2165] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:33 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:33.500632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04ab6a7-0cb3-4268-9d98-8fa0f58828cf None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.505238 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.505904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.506191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.506468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.507199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:33.507504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.509122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.527404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1080/2166] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:52:33.529535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.540591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e35d7c-6d5a-4875-8258-c5c256dc6754 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.550512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.551261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.551600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.551891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.552705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.556952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.587545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1087/2167] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:33 2022] POST /identity/v3/projects => generated 377 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:33.593537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.603620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af9c18b-d9b7-4446-a9b8-b1bfb86850ce admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.653675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.662938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.678913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.679603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.679901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.680319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.681487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.683792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.707770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1081/2168] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:33 2022] POST /identity/v3/users => generated 289 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:33.714016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.725279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9963f4-b655-4651-bb53-1d9f5c4dc119 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.730972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.731664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.731950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.732235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.733154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.734849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.747506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1082/2169] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:33.754048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.767302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ee951e-3f45-443d-a372-6cb21a38caa9 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.770706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05a04bc-8375-47a7-b626-c2ea280d79be admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.777407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.778527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.778914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.779220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] PATH_INFO: `/v3/users/7c231b4be02c43f39bd5e7152b641458` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.780687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c231b4be02c43f39bd5e7152b641458)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.781267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.782217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.782481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.782802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.782962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.783631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.785496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.801773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1083/2170] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:33.802760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:33.814042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10621f06-c46e-4c92-be56-418043350553 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:33.819564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754a0ae2-e343-44cc-b5d6-6f70d182193c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:33.821705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0ae2-e343-44cc-b5d6-6f70d182193c admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.822023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0ae2-e343-44cc-b5d6-6f70d182193c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.822304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754a0ae2-e343-44cc-b5d6-6f70d182193c admin admin] PATH_INFO: `/v3/projects/f5f08429cdb44c8e84cfa13336ac9140/users/548d0e54d9fe448db89b38b74eeffa93/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.845637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a0ae2-e343-44cc-b5d6-6f70d182193c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5f08429cdb44c8e84cfa13336ac9140, user_id=548d0e54d9fe448db89b38b74eeffa93, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:33.848962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754a0ae2-e343-44cc-b5d6-6f70d182193c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:33.866306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c231b4be02c43f39bd5e7152b641458'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.883736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1084/2171] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:33 2022] PUT /identity/v3/projects/f5f08429cdb44c8e84cfa13336ac9140/users/548d0e54d9fe448db89b38b74eeffa93/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:33.890092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.890471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.890820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.893103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c231b4be02c43f39bd5e7152b641458'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.917572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c231b4be02c43f39bd5e7152b641458'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.918692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c231b4be02c43f39bd5e7152b641458'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.922137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] MFA Rules not processed for user `548d0e54d9fe448db89b38b74eeffa93`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:33.923484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.934427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-60a4305c-e318-4c0d-a296-fc63826b74f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c231b4be02c43f39bd5e7152b641458'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:33.937144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1088/2172] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:33 2022] DELETE /identity/v3/users/7c231b4be02c43f39bd5e7152b641458 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:33.942209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:33.944333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:33.944665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:33.966072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:33.966281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:33.967714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:33.978745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:34.007089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1085/2173] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:34.015987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:34.017648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.037081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1089/2174] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:34.046706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:34.048137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.079362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8d4504-916b-4a63-8ea9-6fc91707fa57 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:34.108435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7c8d1-c85e-429c-9ed6-255f8156c257 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:34.112128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:34.112833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:34.113120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:34.113399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:34.123515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:34.124990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:34.129925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb34d6d-8e9c-445c-8567-dcdca559e052 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e34e8f236f4f09a456e10221e2e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:34.130664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb34d6d-8e9c-445c-8567-dcdca559e052 service glance] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:34.130955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb34d6d-8e9c-445c-8567-dcdca559e052 service glance] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:34.131241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb34d6d-8e9c-445c-8567-dcdca559e052 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:34.134743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1090/2175] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:34.190815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb34d6d-8e9c-445c-8567-dcdca559e052 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:34.192405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb34d6d-8e9c-445c-8567-dcdca559e052 service glance] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:34.203559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1086/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:34.299279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:34.302164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.317012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f1e33-992a-4105-b237-8080e105a83f service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:34.321932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:34.324162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:34.324162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:34.324162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] PATH_INFO: `/v3/users/fb9cb0f70ec445d09f8fd6f32a8ace87` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:34.325910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb9cb0f70ec445d09f8fd6f32a8ace87)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:34.327822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:34.394953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb9cb0f70ec445d09f8fd6f32a8ace87'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.405188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb9cb0f70ec445d09f8fd6f32a8ace87'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.425344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb9cb0f70ec445d09f8fd6f32a8ace87'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.426405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb9cb0f70ec445d09f8fd6f32a8ace87'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.436355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb9cb0f70ec445d09f8fd6f32a8ace87'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.453485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1091/2177] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:34 2022] DELETE /identity/v3/users/fb9cb0f70ec445d09f8fd6f32a8ace87 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:34.458195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:34.459629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:34.459913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:34.460608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:34.462445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.492145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:34.496684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.534606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:34.566531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:34.581099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef5016f-064b-461d-b8db-17a48735ad98 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:34.587263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:34.588376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:34.589391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:34.589880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] PATH_INFO: `/v3/projects/734c386934f240d3b9af55440b06aae7` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:34.591277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=734c386934f240d3b9af55440b06aae7)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:34.593462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:34.595290 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1087/2178] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:34.607048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:34.610047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.664998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '734c386934f240d3b9af55440b06aae7', 'request_id': 'req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.675753 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '734c386934f240d3b9af55440b06aae7', 'request_id': 'req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.684806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '734c386934f240d3b9af55440b06aae7', 'request_id': 'req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.689655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a476797-4cd5-494f-9d4e-990b3b882c23 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:34.703109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] The token cache is being invalidate because project 734c386934f240d3b9af55440b06aae7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:34.703409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.704247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.706107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1092/2179] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:34 2022] DELETE /identity/v3/projects/734c386934f240d3b9af55440b06aae7 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:34.710230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:34.711639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.778931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:34.780045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:34.780340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:34.780652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:34.783805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:34.799519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1df3eb-d7e8-46d9-9f17-a0076b2e35fe admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:34.805868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:34.808062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:34.810638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:34.811690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:34.812285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:34.812680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] PATH_INFO: `/v3/users/97dce6f14ab042dca0df40c1c79cffef` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:34.815391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=97dce6f14ab042dca0df40c1c79cffef)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:34.817528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:34.818880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1088/2180] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:34.881516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '97dce6f14ab042dca0df40c1c79cffef'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.891792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '97dce6f14ab042dca0df40c1c79cffef'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.898991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:34.912850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '97dce6f14ab042dca0df40c1c79cffef'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.913724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '97dce6f14ab042dca0df40c1c79cffef'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.924811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '97dce6f14ab042dca0df40c1c79cffef'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:34.931642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1093/2181] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:34 2022] DELETE /identity/v3/users/97dce6f14ab042dca0df40c1c79cffef => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:35.168921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.171535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:35.186226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10792ef8-1130-40a2-9270-b575ce4211bd service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.268224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.269348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.269807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.270093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] PATH_INFO: `/v3/projects/8a33c755d13949fd884164aee4be26fb` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.271635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a33c755d13949fd884164aee4be26fb)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.274250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:35.333424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.335060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:35.353390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:35.359349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820e5995-c96a-4c2d-9459-0a80d3117ee4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.359511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a33c755d13949fd884164aee4be26fb', 'request_id': 'req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.380373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a33c755d13949fd884164aee4be26fb', 'request_id': 'req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.393933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a33c755d13949fd884164aee4be26fb', 'request_id': 'req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.413975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] The token cache is being invalidate because project 8a33c755d13949fd884164aee4be26fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:35.414554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.415222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a419a41-2a30-4aca-9b26-f9bc1d8b3c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.417977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1089/2182] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:35 2022] DELETE /identity/v3/projects/8a33c755d13949fd884164aee4be26fb => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:35.423535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5517-e51d-460b-b6db-50996abab0c7 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.423995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5517-e51d-460b-b6db-50996abab0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.424620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f5517-e51d-460b-b6db-50996abab0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.449023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0e7f5517-e51d-460b-b6db-50996abab0c7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:35.450483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0e7f5517-e51d-460b-b6db-50996abab0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:35.464506 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.465590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.465907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.466191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] PATH_INFO: `/v3/projects/30f402661299423793ddac93ee413716` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.467647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30f402661299423793ddac93ee413716)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.469677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:35.527111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30f402661299423793ddac93ee413716', 'request_id': 'req-3189f616-61a6-448b-84d8-9a3b4b5b3f37'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.535203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30f402661299423793ddac93ee413716', 'request_id': 'req-3189f616-61a6-448b-84d8-9a3b4b5b3f37'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.540679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1090/2183] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:35.542444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30f402661299423793ddac93ee413716', 'request_id': 'req-3189f616-61a6-448b-84d8-9a3b4b5b3f37'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.546985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe4cfa-02aa-4569-82e8-d2a871aaac20 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.547270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe4cfa-02aa-4569-82e8-d2a871aaac20 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.547547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe4cfa-02aa-4569-82e8-d2a871aaac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.555327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] The token cache is being invalidate because project 30f402661299423793ddac93ee413716 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:35.555634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.556569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3189f616-61a6-448b-84d8-9a3b4b5b3f37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:35.558432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1094/2184] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:35 2022] DELETE /identity/v3/projects/30f402661299423793ddac93ee413716 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:35.564018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b894-3212-4499-ba0b-a6a938f5434d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.564313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b894-3212-4499-ba0b-a6a938f5434d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.564632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c47b894-3212-4499-ba0b-a6a938f5434d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.566648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3ffe4cfa-02aa-4569-82e8-d2a871aaac20 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:35.567843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3ffe4cfa-02aa-4569-82e8-d2a871aaac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:35.589630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7c47b894-3212-4499-ba0b-a6a938f5434d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:35.591028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7c47b894-3212-4499-ba0b-a6a938f5434d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:35.673412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1095/2185] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:35.674341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1091/2186] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:35.680537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b894-3212-4499-ba0b-a6a938f5434d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.681362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b866f-c987-4151-85e8-fdcbc0f19a79 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.682583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b866f-c987-4151-85e8-fdcbc0f19a79 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.682583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3b866f-c987-4151-85e8-fdcbc0f19a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.691390 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c47b894-3212-4499-ba0b-a6a938f5434d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.702165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.703043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.704679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-8a3b866f-c987-4151-85e8-fdcbc0f19a79 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:35.705942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8a3b866f-c987-4151-85e8-fdcbc0f19a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:35.706349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.706697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.707600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:35.707924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.709911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:35.712413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:35.717350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1092/2187] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:35.722184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b866f-c987-4151-85e8-fdcbc0f19a79 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.729534 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1096/2188] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:52:35.740894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.744309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3b866f-c987-4151-85e8-fdcbc0f19a79 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.750115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.750795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.751083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.751365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.752149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:35.752451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.754146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:35.754725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d5bc1-2bc0-48d4-a95e-cc30c9e71fe7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.761366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.762313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.762607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.762889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.763648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.765812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:35.769603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1093/2189] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:35.774091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.785723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb88b85-b4aa-4652-944f-60a7a3388980 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.792258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.793025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.793262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.793536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.794477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.796553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:35.803414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1097/2190] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:35.810690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.836112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1094/2191] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:35.841506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:35.909023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:35.926070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d9f3db8-4921-4092-ab88-5544644218dd admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.946055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb52b-629a-4fa0-8c65-436571b1a03c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:35.966250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.967230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.967725 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.968336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.969329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.971729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:35.993520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:35.994222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:35.994525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:35.994861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:35.995591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:35.997866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.022212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1095/2192] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:36.027828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.040448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1098/2193] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:35 2022] POST /identity/v3/users => generated 293 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:36.044658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72f513-46ea-46c8-ad2a-5bbc43417d67 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.045020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.059397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9538c8-bc87-445e-9cda-f4dd82d8ee8b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.062280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.063647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.064095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.064611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.065843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.066261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.066654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.067007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.067394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.068175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.069655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.069854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.088351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1099/2194] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:36.090481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.092036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1096/2195] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:36.096434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.103123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44b431-5e17-4bca-85b3-d954cfe3311c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.108787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.109438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfcf99a-eb48-4f33-b03f-164ca524f4a4 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.109552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.109745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.110029 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.110808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.112843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.115753 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.120845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.121359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.121902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.122861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.124804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.125929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1100/2196] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:36.130358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.141083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1097/2197] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:36.142141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd18ab-f77c-4844-953f-4d632c4da328 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.142256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.148915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f81ff2-80ac-43ef-a2ff-134597fa0c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.149853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f81ff2-80ac-43ef-a2ff-134597fa0c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.150151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f81ff2-80ac-43ef-a2ff-134597fa0c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.150435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f81ff2-80ac-43ef-a2ff-134597fa0c19 admin admin] PATH_INFO: `/v3/projects/c8a2ad1b534543e49fc11073af66a0f3/users/9cb41443e70c4fef9b379df8fe21e710/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.154632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da6de1d-d1d7-40eb-8744-2acd785565df admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.160074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83eed701-84f9-4281-91d8-7cb338ededca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.161031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed701-84f9-4281-91d8-7cb338ededca admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.161310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed701-84f9-4281-91d8-7cb338ededca admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.161590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83eed701-84f9-4281-91d8-7cb338ededca admin admin] PATH_INFO: `/v3/projects/22d6e6848a9648878e556f4c594fe289/users/6590d5ac37c04326a7e66e3fcad84292/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.169013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f81ff2-80ac-43ef-a2ff-134597fa0c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8a2ad1b534543e49fc11073af66a0f3, user_id=9cb41443e70c4fef9b379df8fe21e710, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.171728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f81ff2-80ac-43ef-a2ff-134597fa0c19 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.179782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eed701-84f9-4281-91d8-7cb338ededca admin admin] RBAC: Authorizing `identity:create_grant(project_id=22d6e6848a9648878e556f4c594fe289, user_id=6590d5ac37c04326a7e66e3fcad84292, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.183395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83eed701-84f9-4281-91d8-7cb338ededca admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.187658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1101/2198] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:36 2022] PUT /identity/v3/projects/c8a2ad1b534543e49fc11073af66a0f3/users/9cb41443e70c4fef9b379df8fe21e710/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:36.198493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.198820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.199106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.200904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1098/2199] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:36 2022] PUT /identity/v3/projects/22d6e6848a9648878e556f4c594fe289/users/6590d5ac37c04326a7e66e3fcad84292/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:52:36.212548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.213059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.213676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.235948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] MFA Rules not processed for user `9cb41443e70c4fef9b379df8fe21e710`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:36.237208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:36.247324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] MFA Rules not processed for user `6590d5ac37c04326a7e66e3fcad84292`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:36.248704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:36.251263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:36.326822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1102/2200] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:36.338773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.340477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:36.351515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1099/2201] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:36 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:36.365097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.366521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:36.407822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79e10fc-a753-42b7-b603-c9d772ebb143 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.413827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.413827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.413827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.413827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.424277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.425812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.432513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a7a852-a40f-4b9c-bfaf-ae161c8f746a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.436539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1221a2de-23a7-414c-8bff-fa9d34e6867a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e34e8f236f4f09a456e10221e2e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.437201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221a2de-23a7-414c-8bff-fa9d34e6867a service glance] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.437495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221a2de-23a7-414c-8bff-fa9d34e6867a service glance] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.437778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1221a2de-23a7-414c-8bff-fa9d34e6867a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.441098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1103/2202] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:36.449887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221a2de-23a7-414c-8bff-fa9d34e6867a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.453722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1221a2de-23a7-414c-8bff-fa9d34e6867a service glance] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:36.464142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1100/2203] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:36 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:36.833578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:36.835054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:36.940772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa4f3d-8354-497c-b365-1fc90b8c33d1 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:36.946757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:36.948254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:36.948759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:36.949504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] PATH_INFO: `/v3/users/ff2fb56d06f9428c8e0b4b1f7ec484a1` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:36.951343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff2fb56d06f9428c8e0b4b1f7ec484a1)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:36.953681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:37.009268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff2fb56d06f9428c8e0b4b1f7ec484a1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.021400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff2fb56d06f9428c8e0b4b1f7ec484a1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.027989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:37.037985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff2fb56d06f9428c8e0b4b1f7ec484a1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.038945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff2fb56d06f9428c8e0b4b1f7ec484a1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.047801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff2fb56d06f9428c8e0b4b1f7ec484a1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.069236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1104/2204] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:36 2022] DELETE /identity/v3/users/ff2fb56d06f9428c8e0b4b1f7ec484a1 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:37.071940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:37.073508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:37.076088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:37.096638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:37.100723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:37.112207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:37.185601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1101/2205] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:37.195393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:37.196843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:37.259780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5598d8f6-bb93-496b-b88e-57676e5ec78b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:37.265182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:37.265757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:37.266021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:37.266306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:37.284158 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:37.286020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:37.297207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1105/2206] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:37.602015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:37.603469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:37.623927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83818ecb-8f16-4421-8407-b64ca92f6b74 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:37.628773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:37.629798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:37.630093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:37.630380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] PATH_INFO: `/v3/projects/33e275a499784fd99f84c153a152d158` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:37.631629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=33e275a499784fd99f84c153a152d158)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:37.633582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:37.692611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33e275a499784fd99f84c153a152d158', 'request_id': 'req-1e918402-0954-4067-9aed-b19e63e957cb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.699720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33e275a499784fd99f84c153a152d158', 'request_id': 'req-1e918402-0954-4067-9aed-b19e63e957cb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.721854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33e275a499784fd99f84c153a152d158', 'request_id': 'req-1e918402-0954-4067-9aed-b19e63e957cb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.734462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] The token cache is being invalidate because project 33e275a499784fd99f84c153a152d158 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:37.734756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.735420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.737002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1102/2207] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:37 2022] DELETE /identity/v3/projects/33e275a499784fd99f84c153a152d158 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:37.741998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:37.752768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee95551-2936-4e38-8381-88ed74198b93 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:37.812286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:37.813217 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:37.813538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:37.813822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] PATH_INFO: `/v3/users/d6e8d5a157e8495db46e36a01fc30c40` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:37.815057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6e8d5a157e8495db46e36a01fc30c40)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:37.817077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:37.876695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6e8d5a157e8495db46e36a01fc30c40'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.886245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6e8d5a157e8495db46e36a01fc30c40'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.900087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6e8d5a157e8495db46e36a01fc30c40'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.901458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6e8d5a157e8495db46e36a01fc30c40'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.909152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6e8d5a157e8495db46e36a01fc30c40'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:37.910615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:37.919831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1106/2208] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:37 2022] DELETE /identity/v3/users/d6e8d5a157e8495db46e36a01fc30c40 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:38.246991 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:38.248537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:38.263273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e918402-0954-4067-9aed-b19e63e957cb admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:38.337555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:38.340059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:38.340996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:38.341660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] PATH_INFO: `/v3/projects/65bdd047c5ce43209d0efb68d71dddde` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:38.344328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65bdd047c5ce43209d0efb68d71dddde)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:38.348770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:38.392914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:38.404062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65bdd047c5ce43209d0efb68d71dddde', 'request_id': 'req-a5fd65fe-6c50-47d9-a756-36908571e9c3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.411373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65bdd047c5ce43209d0efb68d71dddde', 'request_id': 'req-a5fd65fe-6c50-47d9-a756-36908571e9c3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.420800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65bdd047c5ce43209d0efb68d71dddde', 'request_id': 'req-a5fd65fe-6c50-47d9-a756-36908571e9c3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.432925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] The token cache is being invalidate because project 65bdd047c5ce43209d0efb68d71dddde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:38.432925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.434286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.436273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1103/2209] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:38 2022] DELETE /identity/v3/projects/65bdd047c5ce43209d0efb68d71dddde => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:38.439964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:38.441699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:38.455076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f533e0-5343-4954-9388-6c380e546a32 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:38.518457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:38.519342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:38.519681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:38.519964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] PATH_INFO: `/v3/users/68fa17e12d1740b697be33a7f4b1fa60` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:38.521444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68fa17e12d1740b697be33a7f4b1fa60)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:38.523366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:38.577698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68fa17e12d1740b697be33a7f4b1fa60'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.590086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68fa17e12d1740b697be33a7f4b1fa60'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.605721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68fa17e12d1740b697be33a7f4b1fa60'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.606455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68fa17e12d1740b697be33a7f4b1fa60'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.616003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68fa17e12d1740b697be33a7f4b1fa60'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:38.623634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1107/2210] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:38 2022] DELETE /identity/v3/users/68fa17e12d1740b697be33a7f4b1fa60 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:38.941658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:38.943189 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:38.958650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd65fe-6c50-47d9-a756-36908571e9c3 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.031877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.033164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.033652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.034080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] PATH_INFO: `/v3/projects/167a934f919f48f9b606070f8fece106` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.035923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167a934f919f48f9b606070f8fece106)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.038252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.092512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.094150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.094392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167a934f919f48f9b606070f8fece106', 'request_id': 'req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.100910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167a934f919f48f9b606070f8fece106', 'request_id': 'req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.108250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c51e38-7b14-487e-bac1-490a92131d5b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.109411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167a934f919f48f9b606070f8fece106', 'request_id': 'req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.120660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] The token cache is being invalidate because project 167a934f919f48f9b606070f8fece106 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:39.121066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.121811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ceed91f8-c4fd-49d7-92ef-07d92fedb1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.123470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1104/2211] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:38 2022] DELETE /identity/v3/projects/167a934f919f48f9b606070f8fece106 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:39.128319 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc56de4-88d3-4c90-8cfa-b34819413627 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.128641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc56de4-88d3-4c90-8cfa-b34819413627 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.128928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc56de4-88d3-4c90-8cfa-b34819413627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.147334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0bc56de4-88d3-4c90-8cfa-b34819413627 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:39.148538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0bc56de4-88d3-4c90-8cfa-b34819413627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.179815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.181142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.181388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.181853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] PATH_INFO: `/v3/users/9cb41443e70c4fef9b379df8fe21e710` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.184012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cb41443e70c4fef9b379df8fe21e710)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.186184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.210834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:39.216333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:39.231588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1105/2212] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:39.241130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85550e-fc1a-47ee-8c19-d90f60f5cf10 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.241468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85550e-fc1a-47ee-8c19-d90f60f5cf10 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.241887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e85550e-fc1a-47ee-8c19-d90f60f5cf10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.257358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cb41443e70c4fef9b379df8fe21e710'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.262158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1e85550e-fc1a-47ee-8c19-d90f60f5cf10 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:39.263679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1e85550e-fc1a-47ee-8c19-d90f60f5cf10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.266258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cb41443e70c4fef9b379df8fe21e710'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.272745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1106/2213] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:52:39.277775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85550e-fc1a-47ee-8c19-d90f60f5cf10 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.284201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cb41443e70c4fef9b379df8fe21e710'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.284201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cb41443e70c4fef9b379df8fe21e710'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.289591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e85550e-fc1a-47ee-8c19-d90f60f5cf10 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.289870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-05a31920-6c78-42ad-8e20-4708ff85e240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cb41443e70c4fef9b379df8fe21e710'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:39.296994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.297678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.297969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.298254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.299000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:39.299294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1108/2214] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:39 2022] DELETE /identity/v3/users/9cb41443e70c4fef9b379df8fe21e710 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:39.299395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.300979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.303807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.304040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.304347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.313941 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1107/2215] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:52:39.318432 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.320116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.322043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:39.323558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.332740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a317508c-a718-4b32-b50f-130584c5dedf admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.388935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1109/2216] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:39.396710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.397390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.397595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.397701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.397968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.398680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.399010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.401154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.429738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1108/2217] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:39 2022] POST /identity/v3/projects => generated 363 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:39.434737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.469440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee3b67-945e-4cf4-a094-73a64b086e07 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.507406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac89be-1081-4ced-8b16-f87cb6babce5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.514146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.514915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.515287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.515497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.516203 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.518243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.527817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.528502 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.528693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.528970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.536946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:39.540376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.541138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1109/2218] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:39 2022] POST /identity/v3/users => generated 282 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:39.543553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.546011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.554957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1110/2219] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:52:39.559363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3aca2d1-52e4-44af-97c6-78c24b986cc7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.564149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.564859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.565151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.565431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.566176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.567807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.584331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1110/2220] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:39.585945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.596771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad601d-2e35-46a9-8978-398da84a280c service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.601877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d321a7e-22e3-4941-9d72-645a703c4f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.602564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321a7e-22e3-4941-9d72-645a703c4f7d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.602857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321a7e-22e3-4941-9d72-645a703c4f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.603143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d321a7e-22e3-4941-9d72-645a703c4f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.603951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d321a7e-22e3-4941-9d72-645a703c4f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.605648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d321a7e-22e3-4941-9d72-645a703c4f7d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.617291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1111/2221] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:39.622893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.638497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b7169c-f691-4cf6-a47c-cdecf3d2d1b4 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.643557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.644472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.644763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.645047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] PATH_INFO: `/v3/projects/f8f1cabe814e4bf2a731e93c5668ac27/users/898a4002a3eb46239614a11ecb9d3f89/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.662279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8f1cabe814e4bf2a731e93c5668ac27, user_id=898a4002a3eb46239614a11ecb9d3f89, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.665328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:39.686209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1111/2222] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:39 2022] PUT /identity/v3/projects/f8f1cabe814e4bf2a731e93c5668ac27/users/898a4002a3eb46239614a11ecb9d3f89/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:39.700926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.700926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.700926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.738326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] MFA Rules not processed for user `898a4002a3eb46239614a11ecb9d3f89`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:39.739751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.844812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1112/2223] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:39 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:39.855181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.857042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.881150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:39.899529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:39.901350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:39.975961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5cc3a-6dea-4b77-b768-6000d9b53cc2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:39.981507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845ed028-29d7-42d8-9c10-46d3d56e50f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:39.982173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed028-29d7-42d8-9c10-46d3d56e50f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:39.982459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed028-29d7-42d8-9c10-46d3d56e50f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:39.982739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845ed028-29d7-42d8-9c10-46d3d56e50f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:39.992549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ed028-29d7-42d8-9c10-46d3d56e50f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:39.994037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845ed028-29d7-42d8-9c10-46d3d56e50f1 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.004158 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb97397-235d-4ad5-ab72-a5c5b974e584 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.004770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1112/2224] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:39 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:40.010208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.011893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.012187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.012493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] PATH_INFO: `/v3/projects/c8a2ad1b534543e49fc11073af66a0f3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.013917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8a2ad1b534543e49fc11073af66a0f3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.016074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.068838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8a2ad1b534543e49fc11073af66a0f3', 'request_id': 'req-d20552be-797e-4bd9-afcf-1859c7a8f0e2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:40.078017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8a2ad1b534543e49fc11073af66a0f3', 'request_id': 'req-d20552be-797e-4bd9-afcf-1859c7a8f0e2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:40.084681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8a2ad1b534543e49fc11073af66a0f3', 'request_id': 'req-d20552be-797e-4bd9-afcf-1859c7a8f0e2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:40.098655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] The token cache is being invalidate because project c8a2ad1b534543e49fc11073af66a0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:40.099222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:40.099736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-d20552be-797e-4bd9-afcf-1859c7a8f0e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:40.101432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1113/2225] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:39 2022] DELETE /identity/v3/projects/c8a2ad1b534543e49fc11073af66a0f3 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:40.107615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde8d8-8835-4d84-8445-8647bf362cda None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.108044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde8d8-8835-4d84-8445-8647bf362cda None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.108465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cde8d8-8835-4d84-8445-8647bf362cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.139397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a1cde8d8-8835-4d84-8445-8647bf362cda None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:40.140669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a1cde8d8-8835-4d84-8445-8647bf362cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:40.217223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1113/2226] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:40.225049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39772996-fca0-45a7-9859-28e77b19c8ec None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.225438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39772996-fca0-45a7-9859-28e77b19c8ec None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.225817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39772996-fca0-45a7-9859-28e77b19c8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.236631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:40.251661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-39772996-fca0-45a7-9859-28e77b19c8ec None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:40.253518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-39772996-fca0-45a7-9859-28e77b19c8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:40.283799 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1114/2227] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:40.285529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde8d8-8835-4d84-8445-8647bf362cda None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:40.298315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cde8d8-8835-4d84-8445-8647bf362cda None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.316277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.317006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.317301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.317589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.318507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:40.318840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.320510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.352578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1114/2228] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:40.354997 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39772996-fca0-45a7-9859-28e77b19c8ec None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:40.366615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39772996-fca0-45a7-9859-28e77b19c8ec None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.373412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.374374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.374747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.375032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.375748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.377824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.407501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1115/2229] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:40 2022] POST /identity/v3/projects => generated 389 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:40.411789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:40.423127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0039761-81e0-49bd-b278-3d72db03fcb2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.481168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.481764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.482057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.482345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.483055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.485072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.505692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1115/2230] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:40 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:40.510381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:40.521942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a8c9e9-c8d8-44fc-adf7-52caea31df78 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.528250 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.529027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.529312 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.529595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.530331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.531925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.544525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1116/2231] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:40.548568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:40.558645 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34fcad7-3c6d-425a-9338-24996574b925 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.563550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867a4b2d-960f-43d9-a22a-0b578f923fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.564301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4b2d-960f-43d9-a22a-0b578f923fe5 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.564688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4b2d-960f-43d9-a22a-0b578f923fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.565125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867a4b2d-960f-43d9-a22a-0b578f923fe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.565947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a4b2d-960f-43d9-a22a-0b578f923fe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.567676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867a4b2d-960f-43d9-a22a-0b578f923fe5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.579001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1116/2232] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:40.583228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:40.594401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca9857a-4c1d-4a93-a0a3-b80e7729f0cc admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.599340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.600229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.600557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.600871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] PATH_INFO: `/v3/projects/2aadc58181d742e7b321a397a143724f/users/d1406b615da141f193ba1f8a3de4b2aa/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.620196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aadc58181d742e7b321a397a143724f, user_id=d1406b615da141f193ba1f8a3de4b2aa, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.620662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.635426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1117/2233] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:40 2022] PUT /identity/v3/projects/2aadc58181d742e7b321a397a143724f/users/d1406b615da141f193ba1f8a3de4b2aa/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:40.647537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.647858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.648234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.677158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] MFA Rules not processed for user `d1406b615da141f193ba1f8a3de4b2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:40.678377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:40.691278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:40.746268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1117/2234] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:40.756918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:40.758709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:40.818232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9463066a-4d3c-41d2-b95d-407779e6f922 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:40.821864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa7856e-3303-4e1c-84c7-068e9329ac03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:40.823195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7856e-3303-4e1c-84c7-068e9329ac03 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:40.823486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7856e-3303-4e1c-84c7-068e9329ac03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:40.823763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa7856e-3303-4e1c-84c7-068e9329ac03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:40.832112 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7856e-3303-4e1c-84c7-068e9329ac03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:40.833564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa7856e-3303-4e1c-84c7-068e9329ac03 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:40.842456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1118/2235] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:40 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:42.428263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:42.429777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:42.502072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a74280a-5c0e-44c9-a785-e3dfc83761e8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:42.507110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:42.508120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:42.508451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:42.508749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] PATH_INFO: `/v3/users/f6325c2f32bb4539b61d4edf1f979813` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:42.510096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6325c2f32bb4539b61d4edf1f979813)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:42.512430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:42.563936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6325c2f32bb4539b61d4edf1f979813'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:42.571584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6325c2f32bb4539b61d4edf1f979813'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:42.572326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6325c2f32bb4539b61d4edf1f979813'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:42.573342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6325c2f32bb4539b61d4edf1f979813'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:42.585563 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6325c2f32bb4539b61d4edf1f979813'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:42.600861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1118/2236] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:42 2022] DELETE /identity/v3/users/f6325c2f32bb4539b61d4edf1f979813 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:42.606307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:42.606832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:42.606925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:42.625167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:42.626391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:42.691831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1119/2237] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:42.702078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:42.703509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:42.740699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:42.766995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5830ae-0778-4a95-b263-24a2a55bb963 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:42.770990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fa2d6b-1833-48b0-a305-39a92f2119e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:42.771643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa2d6b-1833-48b0-a305-39a92f2119e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:42.771928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa2d6b-1833-48b0-a305-39a92f2119e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:42.772205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fa2d6b-1833-48b0-a305-39a92f2119e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:42.782002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa2d6b-1833-48b0-a305-39a92f2119e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:42.783438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fa2d6b-1833-48b0-a305-39a92f2119e6 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:42.793796 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1119/2238] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:43.088497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.090038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:43.102626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0937f5-4787-4501-83d7-cadf89676186 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.107725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.108628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.108918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.109201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] PATH_INFO: `/v3/projects/187ed1427fba4a5dbd5b804ff99a5a79` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.110417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=187ed1427fba4a5dbd5b804ff99a5a79)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.112508 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.156462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:43.164596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '187ed1427fba4a5dbd5b804ff99a5a79', 'request_id': 'req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:43.172066 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '187ed1427fba4a5dbd5b804ff99a5a79', 'request_id': 'req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:43.178342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '187ed1427fba4a5dbd5b804ff99a5a79', 'request_id': 'req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:43.190281 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] The token cache is being invalidate because project 187ed1427fba4a5dbd5b804ff99a5a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:43.190577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:43.191264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-772f7120-f5b6-4f7b-86e4-d8eebcc895b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:43.192888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1120/2239] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:43 2022] DELETE /identity/v3/projects/187ed1427fba4a5dbd5b804ff99a5a79 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:43.198427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716df6d-d011-4a13-8058-437ed0fe69fe None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.198657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716df6d-d011-4a13-8058-437ed0fe69fe None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.198944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716df6d-d011-4a13-8058-437ed0fe69fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.217059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6716df6d-d011-4a13-8058-437ed0fe69fe None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:43.218281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6716df6d-d011-4a13-8058-437ed0fe69fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:43.289519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1120/2240] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:43.298322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853841-4a53-42e0-b853-707b79b38057 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.298622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853841-4a53-42e0-b853-707b79b38057 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.298904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e853841-4a53-42e0-b853-707b79b38057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.320175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6e853841-4a53-42e0-b853-707b79b38057 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:43.321580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6e853841-4a53-42e0-b853-707b79b38057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:43.331394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1121/2241] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:43.336615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716df6d-d011-4a13-8058-437ed0fe69fe None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.348454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716df6d-d011-4a13-8058-437ed0fe69fe None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.354762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.355757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.356067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.356472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.357231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:43.357551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.359461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.376823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1121/2242] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:52:43.381400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853841-4a53-42e0-b853-707b79b38057 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.392323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e853841-4a53-42e0-b853-707b79b38057 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.397527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.398266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.398620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.398957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.399712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.402182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.435095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1122/2243] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:43 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:43.439205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.457483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02fccb7-17e0-4b53-ba4c-3c6210e93314 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.527083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.528021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.528472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.528713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.529426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.531360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.552770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1122/2244] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:43 2022] POST /identity/v3/users => generated 287 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:43.557569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.573332 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deeeb6b5-6081-4f6e-81d6-d0ec44ad74a5 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.578613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.579285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.579595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.579865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.580642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.582319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.594235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1123/2245] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:43.598148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.613058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e0f1ce-211a-4064-b3fa-b05957cb8d6b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.622210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5d8a6-f4d7-4a80-9e15-86e9c7c93130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.622802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d8a6-f4d7-4a80-9e15-86e9c7c93130 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.623139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d8a6-f4d7-4a80-9e15-86e9c7c93130 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.623417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5d8a6-f4d7-4a80-9e15-86e9c7c93130 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.624222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5d8a6-f4d7-4a80-9e15-86e9c7c93130 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.629033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5d8a6-f4d7-4a80-9e15-86e9c7c93130 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.639918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1123/2246] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:43.644333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.654866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581c2f7-a97d-415c-ae53-580a71ea7d01 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.659726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.660730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.661019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.661303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] PATH_INFO: `/v3/projects/467bc635a9d041ff9d8c15907cefb8e6/users/e144f458e26643b4a25767913d00c18d/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.677280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=467bc635a9d041ff9d8c15907cefb8e6, user_id=e144f458e26643b4a25767913d00c18d, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.679936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.693807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1124/2247] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:43 2022] PUT /identity/v3/projects/467bc635a9d041ff9d8c15907cefb8e6/users/e144f458e26643b4a25767913d00c18d/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:43.699516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108dd0-8cc0-4361-bd7b-aa8d84104e72 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.699810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108dd0-8cc0-4361-bd7b-aa8d84104e72 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.700073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108dd0-8cc0-4361-bd7b-aa8d84104e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.717821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-36108dd0-8cc0-4361-bd7b-aa8d84104e72 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:43.719032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-36108dd0-8cc0-4361-bd7b-aa8d84104e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:43.759698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:43.782686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1124/2248] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:43.795168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:43.797239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:43.855660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa042134-53ef-4992-acda-4ef304b4a044 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:43.859433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:43.860083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:43.860367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:43.860679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:43.871014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:43.872475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:43.882052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1125/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:44.586954 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b16d59-3b03-4d07-8801-ca2c30be8330 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:44.587506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b16d59-3b03-4d07-8801-ca2c30be8330 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:44.587506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b16d59-3b03-4d07-8801-ca2c30be8330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:44.618921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-20b16d59-3b03-4d07-8801-ca2c30be8330 None None] MFA Rules not processed for user `e144f458e26643b4a25767913d00c18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:44.621199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-20b16d59-3b03-4d07-8801-ca2c30be8330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:44.732443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1125/2250] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:44.743513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:44.746392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:44.816695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc4434-efb5-4a23-83c3-b9dc178d20ad service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:44.820371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:44.821042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:44.821317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:44.821596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:44.836088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:44.837770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:44.850625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1126/2251] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:46.217887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eedce1-eaa5-4a9b-a42b-13db429110c4 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:46.218497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eedce1-eaa5-4a9b-a42b-13db429110c4 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:46.218497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eedce1-eaa5-4a9b-a42b-13db429110c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:46.237555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-49eedce1-eaa5-4a9b-a42b-13db429110c4 None None] MFA Rules not processed for user `e144f458e26643b4a25767913d00c18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:46.238764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-49eedce1-eaa5-4a9b-a42b-13db429110c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:46.246321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1126/2252] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:51.050786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:51.052193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:51.066658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca8dbba-6876-438f-b17d-5f7761a143ff service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:51.071350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:51.072207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:51.072532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:51.072810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] PATH_INFO: `/v3/users/d1406b615da141f193ba1f8a3de4b2aa` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:51.075003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1406b615da141f193ba1f8a3de4b2aa)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:51.076949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:51.079370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:51.128918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1406b615da141f193ba1f8a3de4b2aa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.137220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1406b615da141f193ba1f8a3de4b2aa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.150850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1406b615da141f193ba1f8a3de4b2aa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.152170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1406b615da141f193ba1f8a3de4b2aa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.159208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1406b615da141f193ba1f8a3de4b2aa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.165282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1127/2253] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:52:51 2022] DELETE /identity/v3/users/d1406b615da141f193ba1f8a3de4b2aa => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:51.170224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:51.170769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:51.170860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:51.189676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:51.190913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:51.258328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1127/2254] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:51.268741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:51.270181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:51.331478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f7e207-16c9-4eb8-949e-423733d2eae1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:51.335054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41399a7b-e85d-4ba3-b7e5-6e9009997fcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:51.335710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399a7b-e85d-4ba3-b7e5-6e9009997fcd service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:51.336000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399a7b-e85d-4ba3-b7e5-6e9009997fcd service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:51.336272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41399a7b-e85d-4ba3-b7e5-6e9009997fcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:51.346780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41399a7b-e85d-4ba3-b7e5-6e9009997fcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:51.348228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41399a7b-e85d-4ba3-b7e5-6e9009997fcd service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:51.358635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1128/2255] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:51.657433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:51.660172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:51.704481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2ace9-d18c-468d-93ff-ae2d8210b3f2 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:51.711156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:51.712039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:51.712328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:51.712647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] PATH_INFO: `/v3/projects/2aadc58181d742e7b321a397a143724f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:51.714083 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aadc58181d742e7b321a397a143724f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:51.716086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:51.780139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aadc58181d742e7b321a397a143724f', 'request_id': 'req-8b84f4e7-b669-440b-9d46-9fbb47c35c69'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.786726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aadc58181d742e7b321a397a143724f', 'request_id': 'req-8b84f4e7-b669-440b-9d46-9fbb47c35c69'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.795633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aadc58181d742e7b321a397a143724f', 'request_id': 'req-8b84f4e7-b669-440b-9d46-9fbb47c35c69'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.797109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:51.812360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] The token cache is being invalidate because project 2aadc58181d742e7b321a397a143724f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:52:51.815390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.816299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-8b84f4e7-b669-440b-9d46-9fbb47c35c69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:52:51.822492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1128/2256] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:52:51 2022] DELETE /identity/v3/projects/2aadc58181d742e7b321a397a143724f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:51.824563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574c4b0-f7cf-497b-b49c-02a67e984066 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:51.825097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574c4b0-f7cf-497b-b49c-02a67e984066 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:51.825607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574c4b0-f7cf-497b-b49c-02a67e984066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:51.847005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f574c4b0-f7cf-497b-b49c-02a67e984066 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:51.851404 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f574c4b0-f7cf-497b-b49c-02a67e984066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:51.915398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1129/2257] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:51.923642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9f005-817a-47ff-a809-1db23ab03ad3 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:51.923947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9f005-817a-47ff-a809-1db23ab03ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:51.924229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da9f005-817a-47ff-a809-1db23ab03ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:51.946241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6da9f005-817a-47ff-a809-1db23ab03ad3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:51.947471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6da9f005-817a-47ff-a809-1db23ab03ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:51.956309 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1129/2258] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:51.960537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574c4b0-f7cf-497b-b49c-02a67e984066 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:51.970474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574c4b0-f7cf-497b-b49c-02a67e984066 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:51.975080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:51.975739 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:51.976030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:51.976315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:51.977093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:52:51.977410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:51.979021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:51.994263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1130/2259] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:52:52.000116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9f005-817a-47ff-a809-1db23ab03ad3 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:52.012804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da9f005-817a-47ff-a809-1db23ab03ad3 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:52.017492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:52.018158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:52.018447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:52.018730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:52.019440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:52.021674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:52.049666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1130/2260] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:51 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:52.053905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:52.065027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace6165e-1040-45fa-9af5-210a57e4fdd2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:52.074480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:52.127263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:52.127944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:52.128236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:52.128555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:52.129262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:52.131200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:52.151137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1131/2261] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:52 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:52:52.155813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:52.166394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61afd4a-af71-4479-9a4e-713d3c966ce2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:52.171713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:52.172396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:52.172698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:52.172982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:52.173720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:52.175338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:52.187348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1131/2262] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:52.191381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:52.201520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a55cbc4-80da-4cf0-bb47-52c0d53743c7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:52.206132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb94eca9-b2e2-4064-ab3f-c69643c12958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:52.206816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94eca9-b2e2-4064-ab3f-c69643c12958 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:52.207100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94eca9-b2e2-4064-ab3f-c69643c12958 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:52.207378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb94eca9-b2e2-4064-ab3f-c69643c12958 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:52.208161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94eca9-b2e2-4064-ab3f-c69643c12958 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:52.209787 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb94eca9-b2e2-4064-ab3f-c69643c12958 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:52.220273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1132/2263] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:52:52.224547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:52.234871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda83bb-78b0-46e6-9912-08f357ff3669 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:52.239614 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:52.240535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:52.240826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:52.241110 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] PATH_INFO: `/v3/projects/b92ca46975cb4975b4e8d98ac15c156f/users/4e982914a4104a23866e8c059d52f453/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:52.257111 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b92ca46975cb4975b4e8d98ac15c156f, user_id=4e982914a4104a23866e8c059d52f453, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:52.259795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:52.273050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1132/2264] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:52 2022] PUT /identity/v3/projects/b92ca46975cb4975b4e8d98ac15c156f/users/4e982914a4104a23866e8c059d52f453/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:52.278862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814452d-f136-40d6-abe9-303d57bc8b7a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:52.279243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814452d-f136-40d6-abe9-303d57bc8b7a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:52.279587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814452d-f136-40d6-abe9-303d57bc8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:52.300160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7814452d-f136-40d6-abe9-303d57bc8b7a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:52.301520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7814452d-f136-40d6-abe9-303d57bc8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:52.366240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1133/2265] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:52.375734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:52.377601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:52.438926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d49c3de-9a7d-4178-9f73-cf018fd00e55 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:52.443091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:52.443942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:52.444268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:52.444585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:52.455442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:52.456923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:52.467407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1133/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:52:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:52:56.736338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e028d-36e9-45a5-815b-3c3da978ca54 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:56.736890 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e028d-36e9-45a5-815b-3c3da978ca54 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:56.736988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e028d-36e9-45a5-815b-3c3da978ca54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:56.768325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-8a0e028d-36e9-45a5-815b-3c3da978ca54 None None] MFA Rules not processed for user `4e982914a4104a23866e8c059d52f453`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:52:56.769593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8a0e028d-36e9-45a5-815b-3c3da978ca54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:52:56.844342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1134/2267] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:52:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:52:56.848276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:56.859811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea961273-4fef-4879-9ed1-81d976cb8e64 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:56.864787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:56.865530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:56.865816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:56.866096 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:56.866875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:56.868871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:56.898399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1134/2268] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:52:56 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:56.903042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e028d-36e9-45a5-815b-3c3da978ca54 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:56.914452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e028d-36e9-45a5-815b-3c3da978ca54 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:56.932572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:56.978362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:56.979145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:56.979581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:56.979869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:56.980741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:56.982707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:57.007973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1135/2269] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:52:56 2022] POST /identity/v3/users => generated 299 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:52:57.012259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:57.029922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019ab87-950a-420e-bc66-f15efdbc293f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:57.034643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:57.035327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:57.035615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:57.035898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:57.036669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:57.038312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:57.050422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1135/2270] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:57.054472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:57.068772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a5e4b-e1c5-4c8f-9686-52647df7aa45 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:57.074003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:57.074917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:57.075207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:57.075484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] PATH_INFO: `/v3/projects/7ed00f1f031849ef99a4350e161076ed/users/9647749bbdc04294b6d5ba74db924189/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:57.096023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed00f1f031849ef99a4350e161076ed, user_id=9647749bbdc04294b6d5ba74db924189, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:57.098939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:57.114972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1136/2271] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:57 2022] PUT /identity/v3/projects/7ed00f1f031849ef99a4350e161076ed/users/9647749bbdc04294b6d5ba74db924189/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:52:57.119115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:57.132015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebf691d-3abb-47c5-90f8-c509cbabd2e2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:57.197809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:52:57.206925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140d7a7e-f9b3-4175-9660-a5dfb3088a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:57.207911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d7a7e-f9b3-4175-9660-a5dfb3088a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:57.208564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d7a7e-f9b3-4175-9660-a5dfb3088a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:57.208874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140d7a7e-f9b3-4175-9660-a5dfb3088a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:57.209684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d7a7e-f9b3-4175-9660-a5dfb3088a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:57.211500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140d7a7e-f9b3-4175-9660-a5dfb3088a49 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:57.222979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1136/2272] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:52:57.226780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:52:57.237660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15fc9d8-c3db-4649-8a4b-76f5acd3f729 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:52:57.242406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:52:57.243296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:52:57.243583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:52:57.243865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] PATH_INFO: `/v3/projects/7ed00f1f031849ef99a4350e161076ed/users/9647749bbdc04294b6d5ba74db924189/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:52:57.248650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ed00f1f031849ef99a4350e161076ed, user_id=9647749bbdc04294b6d5ba74db924189, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:52:57.251759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:52:57.265441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1137/2273] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:52:57 2022] PUT /identity/v3/projects/7ed00f1f031849ef99a4350e161076ed/users/9647749bbdc04294b6d5ba74db924189/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:03.762951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb410-38e2-4700-ad8f-e289281dfb9a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:03.763803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb410-38e2-4700-ad8f-e289281dfb9a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:03.764266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033bb410-38e2-4700-ad8f-e289281dfb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:03.797516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-033bb410-38e2-4700-ad8f-e289281dfb9a None None] MFA Rules not processed for user `9647749bbdc04294b6d5ba74db924189`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:03.799089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-033bb410-38e2-4700-ad8f-e289281dfb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:03.964454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1137/2274] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:03.973298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:03.975174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:04.112921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdd0920-2d28-4671-892e-f9837d739e8f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:04.119058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e34e8f236f4f09a456e10221e2e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:04.120591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:04.121736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:04.122089 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:04.210298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:04.211977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:04.226378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1138/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:04.384264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:04.387418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:04.387418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:04.406662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:04.408017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:04.474108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1138/2276] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:53:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:04.522479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:04.524640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:04.564103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:04.614737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f0d883-e2ea-4b6b-a2e6-cd9cb7cfaf6f service glance] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:04.642583 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f70860-8660-45cb-8414-548062f619a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:04.644084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f70860-8660-45cb-8414-548062f619a3 service swift] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:04.644754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f70860-8660-45cb-8414-548062f619a3 service swift] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:04.645757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f70860-8660-45cb-8414-548062f619a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:04.669579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f70860-8660-45cb-8414-548062f619a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:04.671421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f70860-8660-45cb-8414-548062f619a3 service swift] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:04.688555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1139/2277] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:53:06.424661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:06.431665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:06.532004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b056c17-8f6d-4453-961c-d3f98428698d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:06.537304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:06.540716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:06.541307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:06.541779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] PATH_INFO: `/v3/users/548d0e54d9fe448db89b38b74eeffa93` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:06.543396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=548d0e54d9fe448db89b38b74eeffa93)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:06.545967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:06.593089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:06.643441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '548d0e54d9fe448db89b38b74eeffa93'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:06.656576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '548d0e54d9fe448db89b38b74eeffa93'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:06.657811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '548d0e54d9fe448db89b38b74eeffa93'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:06.660885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '548d0e54d9fe448db89b38b74eeffa93'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:06.686497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '548d0e54d9fe448db89b38b74eeffa93'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:06.718389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:06.719486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:06.720300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:06.720524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1139/2278] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:06 2022] DELETE /identity/v3/users/548d0e54d9fe448db89b38b74eeffa93 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:06.747178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:06.748912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:06.857069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1140/2279] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:06.857183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:06.858694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:06.937584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58e67a-548f-4235-b324-744a3798fd82 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:06.941451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5126eade-eaad-4469-8e12-457ee7c6024b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:06.942222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126eade-eaad-4469-8e12-457ee7c6024b service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:06.942612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126eade-eaad-4469-8e12-457ee7c6024b service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:06.942992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5126eade-eaad-4469-8e12-457ee7c6024b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:06.957293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126eade-eaad-4469-8e12-457ee7c6024b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:06.959367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5126eade-eaad-4469-8e12-457ee7c6024b service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:06.985518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1140/2280] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:07.399622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:07.401700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:07.450659 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017482cb-1fe1-469c-bd96-9e0848cc8b7a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:07.477237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:07.478195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:07.478490 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:07.478777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] PATH_INFO: `/v3/projects/f5f08429cdb44c8e84cfa13336ac9140` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:07.482033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5f08429cdb44c8e84cfa13336ac9140)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:07.488306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:07.606515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5f08429cdb44c8e84cfa13336ac9140', 'request_id': 'req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:07.624806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5f08429cdb44c8e84cfa13336ac9140', 'request_id': 'req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:07.639967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5f08429cdb44c8e84cfa13336ac9140', 'request_id': 'req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:07.662788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] The token cache is being invalidate because project f5f08429cdb44c8e84cfa13336ac9140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:07.663079 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:07.663852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9f4098c2-c8eb-48e4-8f35-7eab525d4efa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:07.666010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1141/2281] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:07 2022] DELETE /identity/v3/projects/f5f08429cdb44c8e84cfa13336ac9140 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:07.674516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee7d5-c18b-495d-815c-659b8672bcc6 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:07.675064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee7d5-c18b-495d-815c-659b8672bcc6 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:07.675302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471ee7d5-c18b-495d-815c-659b8672bcc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:07.697685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-471ee7d5-c18b-495d-815c-659b8672bcc6 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:07.699408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-471ee7d5-c18b-495d-815c-659b8672bcc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:07.802174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1141/2282] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:07.803326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518365-d08e-4453-9a48-f0bb9832a3cb None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:07.804208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518365-d08e-4453-9a48-f0bb9832a3cb None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:07.804764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a518365-d08e-4453-9a48-f0bb9832a3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:07.862530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-0a518365-d08e-4453-9a48-f0bb9832a3cb None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:07.864551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-0a518365-d08e-4453-9a48-f0bb9832a3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:07.891834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1142/2283] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:53:07.896705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee7d5-c18b-495d-815c-659b8672bcc6 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:07.910539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471ee7d5-c18b-495d-815c-659b8672bcc6 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:07.922453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:07.923268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:07.923627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:07.923971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:07.924881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:53:07.928196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:07.932524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:07.963636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1142/2284] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:53:07.964961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518365-d08e-4453-9a48-f0bb9832a3cb None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:07.976950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a518365-d08e-4453-9a48-f0bb9832a3cb None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:07.995557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:07.996239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:07.996552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:07.996825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:07.997537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:07.999451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:08.060806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1143/2285] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:53:07 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:08.064869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:08.086843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1344668a-8b75-4b87-b69b-3e82871aed7f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:08.184184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:08.269615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:08.270314 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:08.270858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:08.271358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:08.272090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:08.280108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:08.328087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1143/2286] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:53:08 2022] POST /identity/v3/users => generated 287 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:08.332268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:08.356261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094848e8-87d1-455f-90f7-6a41d1d827c6 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:08.367859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:08.369040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:08.369331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:08.372073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:08.372875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:08.375494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:08.408823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:08.428129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1144/2287] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:08.432898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:08.448947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044eb9f-4443-48ff-a7bd-a11753a84a69 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:08.465053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3333318d-4a8f-4764-aff2-a64baf9f5a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:08.466297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333318d-4a8f-4764-aff2-a64baf9f5a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:08.466297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333318d-4a8f-4764-aff2-a64baf9f5a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:08.467148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3333318d-4a8f-4764-aff2-a64baf9f5a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:08.467922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333318d-4a8f-4764-aff2-a64baf9f5a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:08.475041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3333318d-4a8f-4764-aff2-a64baf9f5a51 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:08.501420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1144/2288] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:08.505324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:08.523302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b8311-6f06-4281-b8c1-415f8883780a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:08.530023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:08.532876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:08.533406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:08.533913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] PATH_INFO: `/v3/projects/00fe25507f28456b90cd15d4c17efd67/users/c82ed3f564494cefa5b2f39401633ceb/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:08.573676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00fe25507f28456b90cd15d4c17efd67, user_id=c82ed3f564494cefa5b2f39401633ceb, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:08.578571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:08.610273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1145/2289] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:53:08 2022] PUT /identity/v3/projects/00fe25507f28456b90cd15d4c17efd67/users/c82ed3f564494cefa5b2f39401633ceb/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:08.625746 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc159b-3bca-40d7-a80e-9a198137eaee None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:08.626282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc159b-3bca-40d7-a80e-9a198137eaee None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:08.627453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dc159b-3bca-40d7-a80e-9a198137eaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:08.680188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d2dc159b-3bca-40d7-a80e-9a198137eaee None None] MFA Rules not processed for user `c82ed3f564494cefa5b2f39401633ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:08.684301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d2dc159b-3bca-40d7-a80e-9a198137eaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:08.795459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1145/2290] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:09.047203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:09.049084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:09.188816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1794478-bddb-4357-aa6a-020c2d36e9f3 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:09.198896 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e12a5c-86b9-4378-96c4-e912522f18c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:09.199718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e12a5c-86b9-4378-96c4-e912522f18c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:09.200106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e12a5c-86b9-4378-96c4-e912522f18c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:09.200853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e12a5c-86b9-4378-96c4-e912522f18c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:09.242413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e12a5c-86b9-4378-96c4-e912522f18c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:09.245399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e12a5c-86b9-4378-96c4-e912522f18c7 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:09.271601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1146/2291] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:09 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:13.170837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc159b-3bca-40d7-a80e-9a198137eaee None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:13.262477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dc159b-3bca-40d7-a80e-9a198137eaee None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:13.271099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:13.273089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:13.283186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:13.283186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] PATH_INFO: `/v3/users/c82ed3f564494cefa5b2f39401633ceb` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:13.286269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c82ed3f564494cefa5b2f39401633ceb)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:13.298653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:13.362958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:13.414251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c82ed3f564494cefa5b2f39401633ceb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:13.429964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c82ed3f564494cefa5b2f39401633ceb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:13.430842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c82ed3f564494cefa5b2f39401633ceb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:13.433456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c82ed3f564494cefa5b2f39401633ceb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:13.492119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c82ed3f564494cefa5b2f39401633ceb'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:13.564424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1146/2292] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:13 2022] DELETE /identity/v3/users/c82ed3f564494cefa5b2f39401633ceb => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:13.578219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:13.579780 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:13.580579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:13.610288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:13.611751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:13.754293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1147/2293] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:13.764324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:13.766064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:13.868469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02721606-fbb5-42f2-86ad-67aa14d3689c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:13.873288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd95c9e-b862-4fb1-9147-c3730cafd432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:13.873862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd95c9e-b862-4fb1-9147-c3730cafd432 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:13.874131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd95c9e-b862-4fb1-9147-c3730cafd432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:13.874417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd95c9e-b862-4fb1-9147-c3730cafd432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:13.888970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd95c9e-b862-4fb1-9147-c3730cafd432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:13.890952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd95c9e-b862-4fb1-9147-c3730cafd432 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:13.904186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1147/2294] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:14.251423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:14.255363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:14.292351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe37285-34e3-4771-b40f-c017fd771014 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:14.303358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:14.305643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:14.305643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:14.320528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] PATH_INFO: `/v3/projects/00fe25507f28456b90cd15d4c17efd67` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:14.326965 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=00fe25507f28456b90cd15d4c17efd67)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:14.332974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:14.455553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00fe25507f28456b90cd15d4c17efd67', 'request_id': 'req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:14.484970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00fe25507f28456b90cd15d4c17efd67', 'request_id': 'req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:14.508256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00fe25507f28456b90cd15d4c17efd67', 'request_id': 'req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:14.522998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] The token cache is being invalidate because project 00fe25507f28456b90cd15d4c17efd67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:14.523479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:14.524272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5efd750f-657d-4391-b0b3-ae5ef29e3a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:14.529802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1148/2295] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:14 2022] DELETE /identity/v3/projects/00fe25507f28456b90cd15d4c17efd67 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:14.531431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646499-7309-4077-9609-9253ac8e9630 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:14.532256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646499-7309-4077-9609-9253ac8e9630 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:14.532729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12646499-7309-4077-9609-9253ac8e9630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:14.553253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-12646499-7309-4077-9609-9253ac8e9630 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:14.554594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-12646499-7309-4077-9609-9253ac8e9630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:14.656475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1148/2296] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:53:14.663975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f126-7916-442f-853a-596865093cb0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:14.664586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f126-7916-442f-853a-596865093cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:14.665094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e060f126-7916-442f-853a-596865093cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:14.683425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:14.710102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e060f126-7916-442f-853a-596865093cb0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:14.712092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e060f126-7916-442f-853a-596865093cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:14.725149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1149/2297] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:14.729285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646499-7309-4077-9609-9253ac8e9630 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:14.751519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12646499-7309-4077-9609-9253ac8e9630 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:14.765153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:14.765859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:14.766154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:14.766447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:14.767390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:53:14.767716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:14.771077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:14.805404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1149/2298] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:53:14.806912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f126-7916-442f-853a-596865093cb0 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:14.826875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e060f126-7916-442f-853a-596865093cb0 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:14.833252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:14.834275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:14.834567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:14.834847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:14.835555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:14.837736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:14.912359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1150/2299] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:53:14 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:14.915891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:14.933091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4580a2be-4c2f-4b5c-8c0a-39730685e608 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:15.025952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:15.056217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:15.057912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:15.061385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:15.061732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:15.062536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:15.065226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:15.094359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1150/2300] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:53:14 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:15.099831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:15.115255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d89df-0ce4-4b89-8920-ddbefb0e1952 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:15.121563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:15.122300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:15.122592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:15.122878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:15.123894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:15.126424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:15.145256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1151/2301] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:15.146679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:15.170570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196c7ab-3e39-4922-b286-8be9b5196436 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:15.178322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2827ea-bcb8-4c4f-a7e6-93b0417797af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:15.179040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2827ea-bcb8-4c4f-a7e6-93b0417797af admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:15.179313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2827ea-bcb8-4c4f-a7e6-93b0417797af admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:15.179634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2827ea-bcb8-4c4f-a7e6-93b0417797af admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:15.180408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2827ea-bcb8-4c4f-a7e6-93b0417797af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:15.182528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2827ea-bcb8-4c4f-a7e6-93b0417797af admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:15.195810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1151/2302] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:53:15.201463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:15.219016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068c0f6-f6d8-4fa0-92cd-789d17f12285 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:15.233348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:15.234352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:15.234731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:15.235136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] PATH_INFO: `/v3/projects/3fc38dd4729846e7872eaa972b2468e0/users/3366ad8e0e2e4ce8acdfc412056739cd/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:15.267269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc38dd4729846e7872eaa972b2468e0, user_id=3366ad8e0e2e4ce8acdfc412056739cd, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:15.270007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:15.308667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1152/2303] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:53:15 2022] PUT /identity/v3/projects/3fc38dd4729846e7872eaa972b2468e0/users/3366ad8e0e2e4ce8acdfc412056739cd/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:15.310348 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdf66a-b634-49f2-ac38-166c95d75c11 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:15.310717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdf66a-b634-49f2-ac38-166c95d75c11 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:15.311080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fdf66a-b634-49f2-ac38-166c95d75c11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:15.367458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-51fdf66a-b634-49f2-ac38-166c95d75c11 None None] MFA Rules not processed for user `3366ad8e0e2e4ce8acdfc412056739cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:15.370377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-51fdf66a-b634-49f2-ac38-166c95d75c11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:15.584344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1152/2304] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:15.589279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:15.745910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaca50b7-9f8f-4f79-82e3-2c1aa68da31b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:15.753038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:15.754523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:15.754737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:15.755597 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:15.756429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:15.759536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:15.841451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1153/2305] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:53:15 2022] POST /identity/v3/projects => generated 385 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:15.846452 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdf66a-b634-49f2-ac38-166c95d75c11 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:15.861655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fdf66a-b634-49f2-ac38-166c95d75c11 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:16.032728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:16.033887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:16.034333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:16.034826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:16.035754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:16.038065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:16.087206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:16.087856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1153/2306] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:53:15 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:16.101311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9c1cad-6f8d-4eb0-b354-f768c3144faa admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:16.127889 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:16.128892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:16.129336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:16.129777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:16.130674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:16.136222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:16.167739 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:16.189185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1154/2307] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:53:16.194274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836475d3-c950-42d1-924f-4d416ee569e9 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:16.204242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90635433-dd0a-47b4-a755-89f7fe7bc3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:16.207829 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635433-dd0a-47b4-a755-89f7fe7bc3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:16.208134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635433-dd0a-47b4-a755-89f7fe7bc3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:16.208449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90635433-dd0a-47b4-a755-89f7fe7bc3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:16.209243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90635433-dd0a-47b4-a755-89f7fe7bc3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:16.210904 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90635433-dd0a-47b4-a755-89f7fe7bc3a3 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:16.243568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:16.259919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1154/2308] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:16.261487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d878496-6823-4fbb-84d7-5ad420ab652c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:16.276650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:16.277732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:16.279189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:16.279542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] PATH_INFO: `/v3/projects/b1f9b5c1562c476f87294c9e8585a001/users/42896dbc95f34ce5a5496892ca02d88c/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:16.321342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1f9b5c1562c476f87294c9e8585a001, user_id=42896dbc95f34ce5a5496892ca02d88c, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:16.328813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:16.359063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1155/2309] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:53:16 2022] PUT /identity/v3/projects/b1f9b5c1562c476f87294c9e8585a001/users/42896dbc95f34ce5a5496892ca02d88c/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:16.376760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad2ef-458d-4a6d-97d0-9f25cae2a992 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:16.377063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad2ef-458d-4a6d-97d0-9f25cae2a992 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:16.377414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaad2ef-458d-4a6d-97d0-9f25cae2a992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:16.438866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-afaad2ef-458d-4a6d-97d0-9f25cae2a992 None None] MFA Rules not processed for user `42896dbc95f34ce5a5496892ca02d88c`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:16.440216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-afaad2ef-458d-4a6d-97d0-9f25cae2a992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:16.521497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:16.663947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1155/2310] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:16.667902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:16.788646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:16.820235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a82c0-8823-4f31-aa42-15390a8943a2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:16.835314 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:16.836269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:16.836745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:16.837198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:16.838579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:16.840717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:16.904428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1156/2311] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:53:16 2022] POST /identity/v3/projects => generated 385 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:16.905064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaad2ef-458d-4a6d-97d0-9f25cae2a992 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:16.926569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaad2ef-458d-4a6d-97d0-9f25cae2a992 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:17.097959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:17.099141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.099584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.100132 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.111795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:17.111795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:17.142200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1156/2312] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:53:16 2022] POST /identity/v3/users => generated 299 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:53:17.146126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:17.158335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24470771-b6d5-4ca3-a993-0f18099b103c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:17.164339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:17.165095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.165423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.165713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.166976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:17.168823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:17.185086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1157/2313] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:17.189492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:17.208608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d74bba0-19be-46a7-ac66-c93e4413cb41 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:17.214346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:17.215263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.215554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.215835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] PATH_INFO: `/v3/projects/b32e3fbbc6764796bf01e3792e75fec2/users/11cca5442fca4a07a60004efd7661e6f/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.251130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32e3fbbc6764796bf01e3792e75fec2, user_id=11cca5442fca4a07a60004efd7661e6f, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:17.254093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:17.282910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1157/2314] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:53:17 2022] PUT /identity/v3/projects/b32e3fbbc6764796bf01e3792e75fec2/users/11cca5442fca4a07a60004efd7661e6f/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:17.284761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:17.299191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fae79f-98d9-4d8d-aa27-dfd97a0c8291 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:17.391140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:17.393032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:17.395898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:17.396799 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.397081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.397361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.398096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:17.399689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:17.422289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaebf2a-a36a-4326-a60b-f8330b923cbd admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:17.424661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1158/2315] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:53:17.428631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:17.443914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:17.444833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.445119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.445430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] PATH_INFO: `/v3/users/6590d5ac37c04326a7e66e3fcad84292` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.448406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6590d5ac37c04326a7e66e3fcad84292)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:17.449893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43459926-fd38-48fb-a53e-e49affc0bf4f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:17.450402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:17.459589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2949ce5a-f88c-420e-b1e2-b747f4e570d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:17.460938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ce5a-f88c-420e-b1e2-b747f4e570d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.461231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ce5a-f88c-420e-b1e2-b747f4e570d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.461510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2949ce5a-f88c-420e-b1e2-b747f4e570d3 admin admin] PATH_INFO: `/v3/projects/b32e3fbbc6764796bf01e3792e75fec2/users/11cca5442fca4a07a60004efd7661e6f/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.469543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949ce5a-f88c-420e-b1e2-b747f4e570d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b32e3fbbc6764796bf01e3792e75fec2, user_id=11cca5442fca4a07a60004efd7661e6f, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:17.474219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2949ce5a-f88c-420e-b1e2-b747f4e570d3 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:17.511354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1159/2316] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:53:17 2022] PUT /identity/v3/projects/b32e3fbbc6764796bf01e3792e75fec2/users/11cca5442fca4a07a60004efd7661e6f/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:17.530265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.530871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.531139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.556546 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6590d5ac37c04326a7e66e3fcad84292'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:17.578836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6590d5ac37c04326a7e66e3fcad84292'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:17.579939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6590d5ac37c04326a7e66e3fcad84292'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:17.581694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6590d5ac37c04326a7e66e3fcad84292'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:17.597138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] MFA Rules not processed for user `11cca5442fca4a07a60004efd7661e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:17.598269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:17.607828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ade0ad2f-56ec-4f03-9d67-a9747f703ad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6590d5ac37c04326a7e66e3fcad84292'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:17.638376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1158/2317] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:17 2022] DELETE /identity/v3/users/6590d5ac37c04326a7e66e3fcad84292 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:53:17.643092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:17.643655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:17.644279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:17.657644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:17.827808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:17.834258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:17.837140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1160/2318] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:17.853183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:17.855507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:17.963691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:18.027902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c2c5cc-5e8f-447c-ad8e-1002440af799 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:18.035822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1159/2319] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:53:18.054178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:18.056278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:18.207928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cc0fb-a6a9-403b-a72a-54f129c54da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:18.208726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc0fb-a6a9-403b-a72a-54f129c54da5 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:18.209065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc0fb-a6a9-403b-a72a-54f129c54da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:18.209414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cc0fb-a6a9-403b-a72a-54f129c54da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:18.217642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-272cc0fb-a6a9-403b-a72a-54f129c54da5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:18.237765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb5d0c5-f782-4b4e-84ca-8544dbd8552c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:18.246704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:18.247380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:18.247674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:18.247962 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:18.261195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:18.262168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:18.275775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1160/2320] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:53:18.396156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cc0fb-a6a9-403b-a72a-54f129c54da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:18.414364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cc0fb-a6a9-403b-a72a-54f129c54da5 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:18.473549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1161/2321] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:17 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:53:19.328852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:19.339173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:19.391208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e90d7d-1b30-4341-a5dd-742afb44b990 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:19.409201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:19.410511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:19.411864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:19.412369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] PATH_INFO: `/v3/projects/22d6e6848a9648878e556f4c594fe289` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:19.413831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=22d6e6848a9648878e556f4c594fe289)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:19.416586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:19.527467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22d6e6848a9648878e556f4c594fe289', 'request_id': 'req-55492b52-e786-4400-bc24-c921dc955a3e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:19.536742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22d6e6848a9648878e556f4c594fe289', 'request_id': 'req-55492b52-e786-4400-bc24-c921dc955a3e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:19.560259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22d6e6848a9648878e556f4c594fe289', 'request_id': 'req-55492b52-e786-4400-bc24-c921dc955a3e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:19.572428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] The token cache is being invalidate because project 22d6e6848a9648878e556f4c594fe289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:19.572997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:19.573977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:19.575751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1161/2322] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:19 2022] DELETE /identity/v3/projects/22d6e6848a9648878e556f4c594fe289 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:20.127488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79813-f817-4cec-9cf5-b93c2f7ea575 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:20.127999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79813-f817-4cec-9cf5-b93c2f7ea575 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:20.128184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c79813-f817-4cec-9cf5-b93c2f7ea575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:20.147759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-23c79813-f817-4cec-9cf5-b93c2f7ea575 None None] MFA Rules not processed for user `4e982914a4104a23866e8c059d52f453`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:20.149245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-23c79813-f817-4cec-9cf5-b93c2f7ea575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:20.284248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1162/2323] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:20.503616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:20.506063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:20.546500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:20.582988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55492b52-e786-4400-bc24-c921dc955a3e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:20.588255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:20.590112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:20.590409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:20.590808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:20.594131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:20.707174 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:20.709044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:20.723706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1162/2324] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:21.169261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae7ba-49f3-4c90-a723-a912b413e844 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:21.169807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae7ba-49f3-4c90-a723-a912b413e844 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:21.173221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefae7ba-49f3-4c90-a723-a912b413e844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:21.193220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-fefae7ba-49f3-4c90-a723-a912b413e844 None None] MFA Rules not processed for user `e144f458e26643b4a25767913d00c18d`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:21.195016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-fefae7ba-49f3-4c90-a723-a912b413e844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:21.260819 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:21.288027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1163/2325] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:21 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:21.573543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:21.586417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c226a9a-8d52-4b4a-a295-07d3d826423b service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:21.592605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c881f9-2e0f-40ab-8463-b7963ba8ab8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:21.593466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c881f9-2e0f-40ab-8463-b7963ba8ab8b service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:21.593913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c881f9-2e0f-40ab-8463-b7963ba8ab8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:21.594456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c881f9-2e0f-40ab-8463-b7963ba8ab8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:21.596787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-38c881f9-2e0f-40ab-8463-b7963ba8ab8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:21.728992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c881f9-2e0f-40ab-8463-b7963ba8ab8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:21.733911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c881f9-2e0f-40ab-8463-b7963ba8ab8b service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:21.765999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1163/2326] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:23.218147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:23.218663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:23.218754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:23.238864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:23.239412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:23.239762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:23.243650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] MFA Rules not processed for user `fc4e06c1371340a98c2c76457aa74b6a`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:23.245169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:23.298152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:23.304134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:23.350686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1164/2327] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:23.446443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1164/2328] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:53:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:53:23.456876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:23.460230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:23.598267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0741ed-450b-44dd-bded-048063a0ec05 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:23.609280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ea0769-1f81-47f2-884c-e36824625f8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:23.610229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea0769-1f81-47f2-884c-e36824625f8e service swift] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:23.610718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea0769-1f81-47f2-884c-e36824625f8e service swift] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:23.611270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea0769-1f81-47f2-884c-e36824625f8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:23.626319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea0769-1f81-47f2-884c-e36824625f8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:23.628687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ea0769-1f81-47f2-884c-e36824625f8e service swift] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:23.643437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1165/2329] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 30 12:53:24.754823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:24.757783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:24.881684 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:24.974477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78dbcba-25c4-4338-9757-3acb317c91da None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:24.988720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:24.989651 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:24.989939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:24.990218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] PATH_INFO: `/v3/users/898a4002a3eb46239614a11ecb9d3f89` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:24.995419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=898a4002a3eb46239614a11ecb9d3f89)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:25.002327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:25.129119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '898a4002a3eb46239614a11ecb9d3f89'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:25.150804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '898a4002a3eb46239614a11ecb9d3f89'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:25.152062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '898a4002a3eb46239614a11ecb9d3f89'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:25.153323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '898a4002a3eb46239614a11ecb9d3f89'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:25.195918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '898a4002a3eb46239614a11ecb9d3f89'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:25.250177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1165/2330] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:24 2022] DELETE /identity/v3/users/898a4002a3eb46239614a11ecb9d3f89 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:25.251493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:25.251975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:25.252113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:25.320357 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:25.321576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:25.557361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1166/2331] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:25.629291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:25.631055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:25.846275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44627c3c-9849-4b1e-9e11-35124666ff17 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:25.873130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb6bf7-6a25-4f14-9019-999f12425282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:25.874254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb6bf7-6a25-4f14-9019-999f12425282 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:25.875784 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb6bf7-6a25-4f14-9019-999f12425282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:25.876874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb6bf7-6a25-4f14-9019-999f12425282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:25.916668 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb6bf7-6a25-4f14-9019-999f12425282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:25.920736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fb6bf7-6a25-4f14-9019-999f12425282 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:25.967657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1166/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:26.575109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:26.576652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:26.606215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a514af-e959-4f5f-8663-88b663df9516 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:26.660047 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:26.661348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:26.661808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:26.663784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] PATH_INFO: `/v3/projects/f8f1cabe814e4bf2a731e93c5668ac27` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:26.686454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8f1cabe814e4bf2a731e93c5668ac27)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:26.690073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:26.762479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:26.814754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8f1cabe814e4bf2a731e93c5668ac27', 'request_id': 'req-5b356f00-957b-48a0-951b-ae1bbd7b1620'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:26.829518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8f1cabe814e4bf2a731e93c5668ac27', 'request_id': 'req-5b356f00-957b-48a0-951b-ae1bbd7b1620'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:26.855307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8f1cabe814e4bf2a731e93c5668ac27', 'request_id': 'req-5b356f00-957b-48a0-951b-ae1bbd7b1620'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:26.883882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] The token cache is being invalidate because project f8f1cabe814e4bf2a731e93c5668ac27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:26.885338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:26.886860 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:26.890998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1167/2333] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:26 2022] DELETE /identity/v3/projects/f8f1cabe814e4bf2a731e93c5668ac27 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:26.897441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191067d-6612-42e8-a922-e62f6cf1860a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:26.897811 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191067d-6612-42e8-a922-e62f6cf1860a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:26.898033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6191067d-6612-42e8-a922-e62f6cf1860a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:26.932820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6191067d-6612-42e8-a922-e62f6cf1860a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:26.934346 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6191067d-6612-42e8-a922-e62f6cf1860a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:27.061902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:27.080274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:27.082385 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:27.101721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1167/2334] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:53:27.110377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afec92-e794-41c1-af92-f1b988758bce None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.110909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afec92-e794-41c1-af92-f1b988758bce None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.111335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5afec92-e794-41c1-af92-f1b988758bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.157679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e5afec92-e794-41c1-af92-f1b988758bce None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:27.158944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e5afec92-e794-41c1-af92-f1b988758bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:27.180644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1168/2335] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:27.185471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afec92-e794-41c1-af92-f1b988758bce None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:27.200280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5afec92-e794-41c1-af92-f1b988758bce None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:27.230366 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:27.231660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.231974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.232286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.233017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:53:27.233344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:27.234988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:27.246392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b356f00-957b-48a0-951b-ae1bbd7b1620 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:27.283586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:27.287333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.289758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.290587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] PATH_INFO: `/v3/users/3366ad8e0e2e4ce8acdfc412056739cd` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.293892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1169/2336] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 12:53:27.295199 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3366ad8e0e2e4ce8acdfc412056739cd)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:27.295973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:27.301082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:27.330327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88235240-f021-4c2b-8f8d-a0fa23871901 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:27.346416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:27.347138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.347455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.347735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.348650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:27.351860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:27.409225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1170/2337] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:53:27 2022] POST /identity/v3/projects => generated 373 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:27.413035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:27.435070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3366ad8e0e2e4ce8acdfc412056739cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:27.447768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3366ad8e0e2e4ce8acdfc412056739cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:27.504722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3366ad8e0e2e4ce8acdfc412056739cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:27.505768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3366ad8e0e2e4ce8acdfc412056739cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:27.508975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b976009-f3d2-42aa-81a3-e40a661668ad admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:27.517548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:27.518605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.519043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.519635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.520883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:27.523713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:27.532653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5735c9f9-90d6-42ba-8039-1c8762009f26 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3366ad8e0e2e4ce8acdfc412056739cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:27.553179 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1168/2338] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:27 2022] DELETE /identity/v3/users/3366ad8e0e2e4ce8acdfc412056739cd => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:27.554806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.555169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.555501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.579504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1171/2339] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:53:27 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 12:53:27.580193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:27.582451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:27.598734 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:27.599289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230d889-7813-42f3-93fe-52f16a549a0e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:27.604560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:27.688340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:27.757263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1169/2340] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:27.768930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:27.770612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:27.853154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ab42b-5288-4573-b4b6-171c26de1467 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:27.858784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:27.859587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.859919 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.860206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.873123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:27.874763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:27.888766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:27.889672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:27.889984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:27.894694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:27.895836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:27.899372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1170/2341] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:53:27.904215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:27.947513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1172/2342] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:27.949003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:27.992315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35be306c-8136-4895-b65a-77b0dac88c2a service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:28.018265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ed5a28-5542-434f-97b8-2e1e452de06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:28.022686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed5a28-5542-434f-97b8-2e1e452de06c admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:28.024205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed5a28-5542-434f-97b8-2e1e452de06c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:28.027585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ed5a28-5542-434f-97b8-2e1e452de06c admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:28.029520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed5a28-5542-434f-97b8-2e1e452de06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:28.036715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ed5a28-5542-434f-97b8-2e1e452de06c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:28.079772 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:28.083056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1171/2343] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:27 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:28.112810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8943ecc5-88c2-46d4-b895-14aa2fd7d938 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:28.126952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:28.132575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:28.133013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:28.133331 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] PATH_INFO: `/v3/projects/85db66b7bba149839348cab5f76c2c6d/users/d4b67dd2e2164604bb2145f90627eb9b/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:28.191405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85db66b7bba149839348cab5f76c2c6d, user_id=d4b67dd2e2164604bb2145f90627eb9b, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:28.194304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:28.226171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1173/2344] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:53:28 2022] PUT /identity/v3/projects/85db66b7bba149839348cab5f76c2c6d/users/d4b67dd2e2164604bb2145f90627eb9b/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:28.229147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:28.229147 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:28.229602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:28.305350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] MFA Rules not processed for user `d4b67dd2e2164604bb2145f90627eb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:28.307236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:28.490942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1172/2345] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:28.506208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:28.508129 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:28.522210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:28.636716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d41d1a-d2c8-4b16-8fa9-8888ef8f23d6 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:28.649666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:28.652060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:28.652511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:28.652897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:28.674427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:28.676037 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:28.705752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1174/2346] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:28.915298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:28.917126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:29.081800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:29.126628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b831d86-e0f6-4e5d-ad33-e7e0d3698e60 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:29.147297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:29.148244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:29.154391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:29.154807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] PATH_INFO: `/v3/projects/3fc38dd4729846e7872eaa972b2468e0` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:29.169577 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc38dd4729846e7872eaa972b2468e0)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:29.171607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:29.369706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc38dd4729846e7872eaa972b2468e0', 'request_id': 'req-4a1df91b-6eab-4a79-8558-a783e0ef35f4'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.389353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc38dd4729846e7872eaa972b2468e0', 'request_id': 'req-4a1df91b-6eab-4a79-8558-a783e0ef35f4'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.401010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc38dd4729846e7872eaa972b2468e0', 'request_id': 'req-4a1df91b-6eab-4a79-8558-a783e0ef35f4'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.432845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] The token cache is being invalidate because project 3fc38dd4729846e7872eaa972b2468e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:29.433798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.437228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.441778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1173/2347] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:28 2022] DELETE /identity/v3/projects/3fc38dd4729846e7872eaa972b2468e0 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:29.448163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:29.481605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f490338-457a-45b3-93ca-f097fd273e9f service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:29.585885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:29.586800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:29.587089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:29.587926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] PATH_INFO: `/v3/users/42896dbc95f34ce5a5496892ca02d88c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:29.589241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42896dbc95f34ce5a5496892ca02d88c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:29.591905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:29.718029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42896dbc95f34ce5a5496892ca02d88c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.741281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42896dbc95f34ce5a5496892ca02d88c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.742145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42896dbc95f34ce5a5496892ca02d88c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.744530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42896dbc95f34ce5a5496892ca02d88c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.765296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-f91c3a66-4b75-46c7-ac9f-ce0477a696b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42896dbc95f34ce5a5496892ca02d88c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:29.808632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1175/2348] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:29 2022] DELETE /identity/v3/users/42896dbc95f34ce5a5496892ca02d88c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:30.414964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:30.417643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:30.469829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1df91b-6eab-4a79-8558-a783e0ef35f4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:30.575748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:30.577092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:30.577453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:30.578063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] PATH_INFO: `/v3/projects/b1f9b5c1562c476f87294c9e8585a001` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:30.593670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1f9b5c1562c476f87294c9e8585a001)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:30.595846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:30.627055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ff2f-871f-41d7-95b2-3903ecde683f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:30.628134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ff2f-871f-41d7-95b2-3903ecde683f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:30.628647 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219ff2f-871f-41d7-95b2-3903ecde683f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:30.649117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7219ff2f-871f-41d7-95b2-3903ecde683f None None] MFA Rules not processed for user `d4b67dd2e2164604bb2145f90627eb9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:30.651216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7219ff2f-871f-41d7-95b2-3903ecde683f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:30.681246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1f9b5c1562c476f87294c9e8585a001', 'request_id': 'req-961c31d8-2198-4f72-82a2-9699811199cb'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:30.685990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:30.697750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1f9b5c1562c476f87294c9e8585a001', 'request_id': 'req-961c31d8-2198-4f72-82a2-9699811199cb'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:30.710098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1f9b5c1562c476f87294c9e8585a001', 'request_id': 'req-961c31d8-2198-4f72-82a2-9699811199cb'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:30.736154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] The token cache is being invalidate because project b1f9b5c1562c476f87294c9e8585a001 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:30.736623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:30.738126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:30.746202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1174/2349] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:30 2022] DELETE /identity/v3/projects/b1f9b5c1562c476f87294c9e8585a001 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:30.747878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:30.751195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:30.759064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1176/2350] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:53:30.811772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:30.935096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c31d8-2198-4f72-82a2-9699811199cb admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:30.941455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:30.943541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:30.944145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:30.944691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] PATH_INFO: `/v3/users/11cca5442fca4a07a60004efd7661e6f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:30.947387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11cca5442fca4a07a60004efd7661e6f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:30.949691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:31.048037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11cca5442fca4a07a60004efd7661e6f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:31.063254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11cca5442fca4a07a60004efd7661e6f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:31.106792 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11cca5442fca4a07a60004efd7661e6f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:31.112240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11cca5442fca4a07a60004efd7661e6f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:31.132741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-7f713f67-be05-4573-a906-28b74e302f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11cca5442fca4a07a60004efd7661e6f'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:31.159821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1175/2351] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:30 2022] DELETE /identity/v3/users/11cca5442fca4a07a60004efd7661e6f => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:32.148070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219ff2f-871f-41d7-95b2-3903ecde683f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:32.205289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219ff2f-871f-41d7-95b2-3903ecde683f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:32.373459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:32.375416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:32.376191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:32.378642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] PATH_INFO: `/v3/projects/b32e3fbbc6764796bf01e3792e75fec2` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:32.381887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b32e3fbbc6764796bf01e3792e75fec2)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:32.390712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:32.551216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b32e3fbbc6764796bf01e3792e75fec2', 'request_id': 'req-54155ee8-3d39-4a41-a76c-f429c7de2244'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:32.568217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b32e3fbbc6764796bf01e3792e75fec2', 'request_id': 'req-54155ee8-3d39-4a41-a76c-f429c7de2244'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:32.598616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b32e3fbbc6764796bf01e3792e75fec2', 'request_id': 'req-54155ee8-3d39-4a41-a76c-f429c7de2244'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:32.631418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] The token cache is being invalidate because project b32e3fbbc6764796bf01e3792e75fec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:32.631774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:32.632832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:32.635972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1177/2352] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:32 2022] DELETE /identity/v3/projects/b32e3fbbc6764796bf01e3792e75fec2 => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:38.360419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a226c-3485-491e-9db4-fccbcb89005b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:38.360419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a226c-3485-491e-9db4-fccbcb89005b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:38.360419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0a226c-3485-491e-9db4-fccbcb89005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:38.404233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-2b0a226c-3485-491e-9db4-fccbcb89005b None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:38.406432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2b0a226c-3485-491e-9db4-fccbcb89005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:38.536166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1176/2353] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:53:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:38.552759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:38.554271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:38.670506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:38.730733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54155ee8-3d39-4a41-a76c-f429c7de2244 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:38.737613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8fe63c-15d8-4ab8-8154-369d3978b670 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:38.738321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe63c-15d8-4ab8-8154-369d3978b670 service swift] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:38.738613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe63c-15d8-4ab8-8154-369d3978b670 service swift] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:38.740280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8fe63c-15d8-4ab8-8154-369d3978b670 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:38.764322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe63c-15d8-4ab8-8154-369d3978b670 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:38.769429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8fe63c-15d8-4ab8-8154-369d3978b670 service swift] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:38.812358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1178/2354] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:53:48.532928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:48.798853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=15 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:51.877702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de712c-00c7-4782-a927-f36fa557c83d None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:51.878265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de712c-00c7-4782-a927-f36fa557c83d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:51.878375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0de712c-00c7-4782-a927-f36fa557c83d None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:51.879884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1177/2355] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:53:51.888623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:51.889140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:51.889232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:51.973644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de712c-00c7-4782-a927-f36fa557c83d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:51.976343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a0de712c-00c7-4782-a927-f36fa557c83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:51.998955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:52.000204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:52.090926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1179/2356] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:53:51 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:52.108946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:52.111947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:52.135403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9c26c6-911f-44a7-889f-4937ad1e934e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:52.140665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:52.141149 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0de712c-00c7-4782-a927-f36fa557c83d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:52.141380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:52.141679 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:52.141965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:52.146507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:52.147461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:52.147911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:52.148163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] PATH_INFO: `/v3/users/e144f458e26643b4a25767913d00c18d` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:52.150203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e144f458e26643b4a25767913d00c18d)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:52.152274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:52.152443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:52.154016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:52.165643 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1180/2357] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:52.209962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e144f458e26643b4a25767913d00c18d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.222757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e144f458e26643b4a25767913d00c18d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.253770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e144f458e26643b4a25767913d00c18d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.255059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e144f458e26643b4a25767913d00c18d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.264916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e08a2d91-3c39-4a69-b0e1-9e360b34f5dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e144f458e26643b4a25767913d00c18d'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.276525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1178/2358] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:51 2022] DELETE /identity/v3/users/e144f458e26643b4a25767913d00c18d => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:52.745727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:52.756768 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c3f247-1177-41d0-836c-31a473bc47d2 service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:52.879470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:52.880241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:52.880570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:52.880853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] PATH_INFO: `/v3/projects/467bc635a9d041ff9d8c15907cefb8e6` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:52.883075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=467bc635a9d041ff9d8c15907cefb8e6)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:52.886180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:52.945006 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:52.958792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '467bc635a9d041ff9d8c15907cefb8e6', 'request_id': 'req-6d668be0-904d-47e5-bf44-80b421cc7f91'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.966125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '467bc635a9d041ff9d8c15907cefb8e6', 'request_id': 'req-6d668be0-904d-47e5-bf44-80b421cc7f91'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.977688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '467bc635a9d041ff9d8c15907cefb8e6', 'request_id': 'req-6d668be0-904d-47e5-bf44-80b421cc7f91'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.992320 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] The token cache is being invalidate because project 467bc635a9d041ff9d8c15907cefb8e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:53:52.992665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.994196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-6d668be0-904d-47e5-bf44-80b421cc7f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:52.996161 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1181/2359] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:53:52 2022] DELETE /identity/v3/projects/467bc635a9d041ff9d8c15907cefb8e6 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:53.001875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287c0a-5645-43b2-b4f9-3a928f30fa1b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.002769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287c0a-5645-43b2-b4f9-3a928f30fa1b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.003237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a287c0a-5645-43b2-b4f9-3a928f30fa1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.073599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1a287c0a-5645-43b2-b4f9-3a928f30fa1b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:53.075277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1a287c0a-5645-43b2-b4f9-3a928f30fa1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:53.108441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:53.147656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1179/2360] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:53.155672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c43858-817a-40d2-a8fa-a8c351e6b6f3 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.156168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c43858-817a-40d2-a8fa-a8c351e6b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.156512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c43858-817a-40d2-a8fa-a8c351e6b6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.176239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d2c43858-817a-40d2-a8fa-a8c351e6b6f3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:53.177571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d2c43858-817a-40d2-a8fa-a8c351e6b6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:53.185875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1182/2361] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:53.190242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287c0a-5645-43b2-b4f9-3a928f30fa1b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:53.200564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a287c0a-5645-43b2-b4f9-3a928f30fa1b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:53.205350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:53.206011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.206300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.206584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.207364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:53:53.207708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:53.209343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:53.221958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1180/2362] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:53:53.226312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c43858-817a-40d2-a8fa-a8c351e6b6f3 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:53.236547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c43858-817a-40d2-a8fa-a8c351e6b6f3 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:53.241303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:53.241958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.242249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.242529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.243716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:53.245696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:53.273694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1183/2363] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:53:53 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:53.278809 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:53.289043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb46ce-2a5f-45dc-b13a-38bdbe64e9a7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:53.356754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:53.357440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.358166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.358457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.359227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:53.361190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:53.385126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1181/2364] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:53:53 2022] POST /identity/v3/users => generated 284 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:53:53.388528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:53.400613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a34e1a-581a-467c-9ba6-99814a4cb7b2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:53.405578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:53.406383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.406675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.406953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.407690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:53.409356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:53.422315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1184/2365] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:53.426233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:53.440374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d97f94-c5b8-4acb-8ada-b5b7677df707 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:53.445207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a94a541-310b-46ff-8580-c44b3cd5507f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:53.446504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a541-310b-46ff-8580-c44b3cd5507f admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.446669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a541-310b-46ff-8580-c44b3cd5507f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.446976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a94a541-310b-46ff-8580-c44b3cd5507f admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.447822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a541-310b-46ff-8580-c44b3cd5507f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:53.449465 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a94a541-310b-46ff-8580-c44b3cd5507f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:53.463816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1182/2366] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:53:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:53:53.465686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:53.475837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362f51a-749f-4b01-8695-38dde9c465e5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:53.481099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:53.481995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.482285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.482567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] PATH_INFO: `/v3/projects/31de6c73e6754eef84da48b473980313/users/cd660e2184444deaa1424c21ccad867b/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.499479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=31de6c73e6754eef84da48b473980313, user_id=cd660e2184444deaa1424c21ccad867b, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:53.502365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:53.518574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1185/2367] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:53:53 2022] PUT /identity/v3/projects/31de6c73e6754eef84da48b473980313/users/cd660e2184444deaa1424c21ccad867b/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:53.529846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e077-a4cf-4ab0-aaf8-35a913086010 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.530166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e077-a4cf-4ab0-aaf8-35a913086010 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.530451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a783e077-a4cf-4ab0-aaf8-35a913086010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.558641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a783e077-a4cf-4ab0-aaf8-35a913086010 None None] MFA Rules not processed for user `cd660e2184444deaa1424c21ccad867b`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:53.559853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a783e077-a4cf-4ab0-aaf8-35a913086010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:53.631607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1183/2368] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:53.644441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:53.646501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:53.705800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f8d842-612d-4f15-9448-3f2e970fc7fe admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:53.709471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e34e8f236f4f09a456e10221e2e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:53.710114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:53.710399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:53.710678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:53.719075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:53.720539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:53.729278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1186/2369] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:53 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:55.410027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407bd9-7431-49a4-8727-2ac0fd8496c7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:55.410502 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407bd9-7431-49a4-8727-2ac0fd8496c7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:55.410600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60407bd9-7431-49a4-8727-2ac0fd8496c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:55.430588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-60407bd9-7431-49a4-8727-2ac0fd8496c7 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:55.432481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-60407bd9-7431-49a4-8727-2ac0fd8496c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:55.454127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:55.498901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1184/2370] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:53:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:53:55.511399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:55.512839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:55.581558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:55.586181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39a69c-a10e-41e7-8efa-bc935bff7b5f service glance] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:55.593438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:55.594092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:55.594381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:55.594662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:55.603952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:55.605922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:55.616486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1187/2371] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:53:56.178253 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45297-39bc-4f28-8ea6-9b7409c52f82 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:56.178563 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45297-39bc-4f28-8ea6-9b7409c52f82 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:56.178875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d45297-39bc-4f28-8ea6-9b7409c52f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:56.202952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-95d45297-39bc-4f28-8ea6-9b7409c52f82 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:56.204084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-95d45297-39bc-4f28-8ea6-9b7409c52f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:56.211456 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1185/2372] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 30 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:56.224737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:56.237022 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e551f8a-2029-4468-be57-21439e0d5148 service swift] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:56.242276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:56.242946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:56.243216 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:56.243523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:56.252880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:56.254238 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:56.268086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1188/2373] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:53:56.418937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b3a7-7223-4146-b1f6-81ce22c240d4 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:56.419399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b3a7-7223-4146-b1f6-81ce22c240d4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:56.419545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4b3a7-7223-4146-b1f6-81ce22c240d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:56.442322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3ff4b3a7-7223-4146-b1f6-81ce22c240d4 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:56.443574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3ff4b3a7-7223-4146-b1f6-81ce22c240d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:56.452741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1186/2374] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 30 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:56.465693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:56.481115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59d91b1-2c3a-4b58-ac25-c5741d055c1b service swift] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:56.486249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:56.486903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:56.487188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:56.487471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:56.497139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:56.498738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:56.507181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1189/2375] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:53:56.899757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c8889-f8b5-42d5-8109-6a2dc0232f61 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:56.899757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c8889-f8b5-42d5-8109-6a2dc0232f61 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:56.899757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0c8889-f8b5-42d5-8109-6a2dc0232f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:56.918640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9c0c8889-f8b5-42d5-8109-6a2dc0232f61 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:56.919853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9c0c8889-f8b5-42d5-8109-6a2dc0232f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:56.928245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1187/2376] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:53:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:56.940559 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:56.952089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60798f8-269d-4432-ad00-f32f8f1eedf3 service swift] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:56.957603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:56.958296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:56.958593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:56.958872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:56.968603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:56.970209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:56.979369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1190/2377] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:53:57.319590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244b43-9f4d-43ad-a3e5-a15bc3ffaeb7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:57.319823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244b43-9f4d-43ad-a3e5-a15bc3ffaeb7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:57.320183 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06244b43-9f4d-43ad-a3e5-a15bc3ffaeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:57.340732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-06244b43-9f4d-43ad-a3e5-a15bc3ffaeb7 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:57.342258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-06244b43-9f4d-43ad-a3e5-a15bc3ffaeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:57.350105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1188/2378] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 30 12:53:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:57.371701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:57.386856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8292b8-9150-4444-8cf0-e6642ffbdb56 service swift] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:57.393543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a0f9a4-f0f7-4b86-966c-665fe9e50e05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:57.394196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f9a4-f0f7-4b86-966c-665fe9e50e05 service swift] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:57.394481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f9a4-f0f7-4b86-966c-665fe9e50e05 service swift] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:57.394944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a0f9a4-f0f7-4b86-966c-665fe9e50e05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:57.411751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0f9a4-f0f7-4b86-966c-665fe9e50e05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:57.413415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a0f9a4-f0f7-4b86-966c-665fe9e50e05 service swift] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:57.422295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1191/2379] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:53:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:53:58.112479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816176-ed23-4c16-a2d9-3758f1f3493c None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:58.113013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816176-ed23-4c16-a2d9-3758f1f3493c None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:58.113367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84816176-ed23-4c16-a2d9-3758f1f3493c None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:58.114668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1189/2380] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 30 12:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:53:58.124512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:58.124964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:58.125085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:58.153742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:53:58.155157 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:58.238044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1192/2381] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:53:58 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:53:58.265259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816176-ed23-4c16-a2d9-3758f1f3493c None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:58.267011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-84816176-ed23-4c16-a2d9-3758f1f3493c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:58.285785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84816176-ed23-4c16-a2d9-3758f1f3493c None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:58.297658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f87438e-55d2-41ef-9e52-0dd4a8304489 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:58.298596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87438e-55d2-41ef-9e52-0dd4a8304489 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:58.298961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87438e-55d2-41ef-9e52-0dd4a8304489 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:58.299316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f87438e-55d2-41ef-9e52-0dd4a8304489 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:58.309868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87438e-55d2-41ef-9e52-0dd4a8304489 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:58.311876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f87438e-55d2-41ef-9e52-0dd4a8304489 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:58.331450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1190/2382] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:53:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:53:59.768532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:53:59.770002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:53:59.855785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9a8902-5f65-451e-92b1-050823503a40 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:53:59.860678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:53:59.861686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:59.861998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:59.862279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] PATH_INFO: `/v3/users/d4b67dd2e2164604bb2145f90627eb9b` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:53:59.863800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b67dd2e2164604bb2145f90627eb9b)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:53:59.866835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:53:59.914912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:53:59.925913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b67dd2e2164604bb2145f90627eb9b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:59.941973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b67dd2e2164604bb2145f90627eb9b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:59.943409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b67dd2e2164604bb2145f90627eb9b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:59.944210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b67dd2e2164604bb2145f90627eb9b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:59.962311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b67dd2e2164604bb2145f90627eb9b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:53:59.975960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1193/2383] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:53:59 2022] DELETE /identity/v3/users/d4b67dd2e2164604bb2145f90627eb9b => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:53:59.981879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:53:59.982427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:53:59.982519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:00.001117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:54:00.002350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:00.074190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1191/2384] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:53:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:54:00.085515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:00.087198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:00.177011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb3eec-097f-43b5-930f-dd546fb5752e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:00.180872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e58600-965d-438b-95b2-33ad8475b320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:00.182599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58600-965d-438b-95b2-33ad8475b320 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:00.182599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58600-965d-438b-95b2-33ad8475b320 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:00.182599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e58600-965d-438b-95b2-33ad8475b320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:00.192516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58600-965d-438b-95b2-33ad8475b320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:00.193979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e58600-965d-438b-95b2-33ad8475b320 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:00.204638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1194/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:54:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:54:00.399331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:00.401125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:00.414737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6d4d38-7e05-481e-a615-d80877d441f3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:00.419797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:00.420932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:00.421223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:00.421502 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] PATH_INFO: `/v3/projects/85db66b7bba149839348cab5f76c2c6d` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:00.423002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85db66b7bba149839348cab5f76c2c6d)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:00.425391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:00.485220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85db66b7bba149839348cab5f76c2c6d', 'request_id': 'req-e5539265-fdc2-4d25-9c65-db9cb62f6318'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:00.500849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85db66b7bba149839348cab5f76c2c6d', 'request_id': 'req-e5539265-fdc2-4d25-9c65-db9cb62f6318'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:00.510756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85db66b7bba149839348cab5f76c2c6d', 'request_id': 'req-e5539265-fdc2-4d25-9c65-db9cb62f6318'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:00.527119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] The token cache is being invalidate because project 85db66b7bba149839348cab5f76c2c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:54:00.527419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:00.528105 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:00.530209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1192/2386] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:54:00 2022] DELETE /identity/v3/projects/85db66b7bba149839348cab5f76c2c6d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:54:00.692798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7493943-b892-413e-a1e1-c9cc3e1b986e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:00.693375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7493943-b892-413e-a1e1-c9cc3e1b986e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:00.693667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7493943-b892-413e-a1e1-c9cc3e1b986e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:00.714222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e7493943-b892-413e-a1e1-c9cc3e1b986e None None] MFA Rules not processed for user `2a859567189a41e2b7edd6a2e17f87c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:54:00.715479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e7493943-b892-413e-a1e1-c9cc3e1b986e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:00.792020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1195/2387] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:54:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:54:10.520653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:54:10.780851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=75,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:54:17.733551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:17.734980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:17.801987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5539265-fdc2-4d25-9c65-db9cb62f6318 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:17.807016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:17.807886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:17.808732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:17.809017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] PATH_INFO: `/v3/users/cd660e2184444deaa1424c21ccad867b` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:17.810221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd660e2184444deaa1424c21ccad867b)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:17.812228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:17.860048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd660e2184444deaa1424c21ccad867b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:17.867629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd660e2184444deaa1424c21ccad867b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:17.880436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd660e2184444deaa1424c21ccad867b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:17.881072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd660e2184444deaa1424c21ccad867b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:17.888085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd660e2184444deaa1424c21ccad867b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:17.894136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1193/2388] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:54:17 2022] DELETE /identity/v3/users/cd660e2184444deaa1424c21ccad867b => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:54:17.898942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:17.899409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:17.899524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:17.917054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:54:17.918774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:17.978427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1196/2389] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:54:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:54:17.989081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:17.990483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:18.049956 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9388595-9ec7-481d-9b52-011759cbff48 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.053682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a03ec2-c1cb-4b8a-a422-56bcf597d24f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.054329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03ec2-c1cb-4b8a-a422-56bcf597d24f service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.054614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03ec2-c1cb-4b8a-a422-56bcf597d24f service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.054894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a03ec2-c1cb-4b8a-a422-56bcf597d24f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.065271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a03ec2-c1cb-4b8a-a422-56bcf597d24f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.066696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a03ec2-c1cb-4b8a-a422-56bcf597d24f service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.076761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1194/2390] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:54:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:54:18.364460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:18.365916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:18.378644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8acff6-3a00-4cfc-a836-3a877c017c0f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.383275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.384153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.384443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.384726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] PATH_INFO: `/v3/projects/31de6c73e6754eef84da48b473980313` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.385923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31de6c73e6754eef84da48b473980313)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.388794 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.436537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31de6c73e6754eef84da48b473980313', 'request_id': 'req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:18.442629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31de6c73e6754eef84da48b473980313', 'request_id': 'req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:18.451019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31de6c73e6754eef84da48b473980313', 'request_id': 'req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:18.462506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] The token cache is being invalidate because project 31de6c73e6754eef84da48b473980313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:54:18.462800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:18.463441 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ca5a2bd7-7c76-403f-b792-3989f8bb2c90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:18.465107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1197/2391] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:54:18 2022] DELETE /identity/v3/projects/31de6c73e6754eef84da48b473980313 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:54:18.470004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed311e-2dca-4a5e-8f85-b43b927122b6 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.470300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed311e-2dca-4a5e-8f85-b43b927122b6 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.470588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed311e-2dca-4a5e-8f85-b43b927122b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.489795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6bed311e-2dca-4a5e-8f85-b43b927122b6 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:54:18.491408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6bed311e-2dca-4a5e-8f85-b43b927122b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:18.514820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:54:18.560759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1195/2392] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:54:18.568911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1131-e8f1-4d36-be8c-f19dbe08c91d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.569206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1131-e8f1-4d36-be8c-f19dbe08c91d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.569490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135b1131-e8f1-4d36-be8c-f19dbe08c91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.587767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-135b1131-e8f1-4d36-be8c-f19dbe08c91d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:54:18.589008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-135b1131-e8f1-4d36-be8c-f19dbe08c91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:18.596835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1198/2393] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:54:18.601051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed311e-2dca-4a5e-8f85-b43b927122b6 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:18.612834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed311e-2dca-4a5e-8f85-b43b927122b6 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.617593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.618271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.618551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.618987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.619722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:54:18.620559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.622982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.635596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1196/2394] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:54:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:54:18.640066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1131-e8f1-4d36-be8c-f19dbe08c91d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:18.651957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135b1131-e8f1-4d36-be8c-f19dbe08c91d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.656667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.657324 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.657615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.657920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.658616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.660572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.687377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1199/2395] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:54:18 2022] POST /identity/v3/projects => generated 399 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:54:18.691604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:18.702062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cef87-5fbe-45eb-b5ce-c9d5d6736bf4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.758242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.758911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.759171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.759444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.760120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.762152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.782480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1197/2396] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:54:18 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:54:18.787613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:18.800787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6839ad7-c692-403a-8663-bfc4a5733c3c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.805521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.806286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.806602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.806880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.807619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.809923 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.821609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1200/2397] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:54:18.826143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:18.836528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cf384c-8091-4f8d-b00c-bc5d85363e06 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.841270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb77c35-69ac-4979-8638-9269ee14739c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.841931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77c35-69ac-4979-8638-9269ee14739c admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.842222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77c35-69ac-4979-8638-9269ee14739c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.842505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb77c35-69ac-4979-8638-9269ee14739c admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.843266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77c35-69ac-4979-8638-9269ee14739c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.844911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb77c35-69ac-4979-8638-9269ee14739c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.855458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1198/2398] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:54:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:54:18.859601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:18.870032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c967c6d4-fcec-4450-a092-822fbc13e3a9 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:18.875524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:18.876420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.876716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.876994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] PATH_INFO: `/v3/projects/5b576544d46f4547ae4b0360cd7a3825/users/1dceb6bc876341be9452fbc4106c16cd/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.891393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b576544d46f4547ae4b0360cd7a3825, user_id=1dceb6bc876341be9452fbc4106c16cd, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:18.894098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:18.907871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1201/2399] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:54:18 2022] PUT /identity/v3/projects/5b576544d46f4547ae4b0360cd7a3825/users/1dceb6bc876341be9452fbc4106c16cd/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:54:18.918839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf476-b03a-4f46-9a19-2007cdc7d136 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:18.919131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf476-b03a-4f46-9a19-2007cdc7d136 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:18.919408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cdf476-b03a-4f46-9a19-2007cdc7d136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:18.945610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f7cdf476-b03a-4f46-9a19-2007cdc7d136 None None] MFA Rules not processed for user `1dceb6bc876341be9452fbc4106c16cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:54:18.946828 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f7cdf476-b03a-4f46-9a19-2007cdc7d136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:19.010547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1199/2400] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:54:18 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:54:19.023005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:19.024761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:19.047802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:54:19.106896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d392b34-4b4e-4586-9503-a34ccdea7cc1 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:19.110887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e96f649-b33c-4f3c-9216-d1a6a8673207 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:19.111537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f649-b33c-4f3c-9216-d1a6a8673207 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:19.111825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f649-b33c-4f3c-9216-d1a6a8673207 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:19.112106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e96f649-b33c-4f3c-9216-d1a6a8673207 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:19.121410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96f649-b33c-4f3c-9216-d1a6a8673207 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:19.122852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e96f649-b33c-4f3c-9216-d1a6a8673207 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:19.131650 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1202/2401] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:54:19 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:54:24.133784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf476-b03a-4f46-9a19-2007cdc7d136 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:24.154581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:54:24.199915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cdf476-b03a-4f46-9a19-2007cdc7d136 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:24.204335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:24.205263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:24.205553 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:24.205832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] PATH_INFO: `/v3/users/1dceb6bc876341be9452fbc4106c16cd` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:24.207027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dceb6bc876341be9452fbc4106c16cd)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:24.208989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:24.256036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dceb6bc876341be9452fbc4106c16cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.267915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dceb6bc876341be9452fbc4106c16cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.282026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dceb6bc876341be9452fbc4106c16cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.282737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dceb6bc876341be9452fbc4106c16cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.289704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dceb6bc876341be9452fbc4106c16cd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.295878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1200/2402] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:54:24 2022] DELETE /identity/v3/users/1dceb6bc876341be9452fbc4106c16cd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:54:24.300455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:24.300930 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:24.301032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:24.320045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:54:24.321304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:24.382367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1203/2403] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:54:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:54:24.393296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:24.394719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:24.454330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e1f8c-114b-4ca6-976b-1a2eef3fc9b4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:24.457976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:24.458625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:24.458916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:24.459230 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:24.468755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:24.470222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:24.479834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1201/2404] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:54:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:54:24.764028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:24.765539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:24.783918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dddf72-9ca7-4695-bd10-84945975677d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:24.788907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:24.789793 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:24.790087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:24.790368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] PATH_INFO: `/v3/projects/5b576544d46f4547ae4b0360cd7a3825` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:24.791690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b576544d46f4547ae4b0360cd7a3825)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:24.793977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:24.844521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b576544d46f4547ae4b0360cd7a3825', 'request_id': 'req-081c532b-3f82-42ae-ba9c-3dcd09401ae0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.850700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b576544d46f4547ae4b0360cd7a3825', 'request_id': 'req-081c532b-3f82-42ae-ba9c-3dcd09401ae0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.859019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b576544d46f4547ae4b0360cd7a3825', 'request_id': 'req-081c532b-3f82-42ae-ba9c-3dcd09401ae0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.869714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] The token cache is being invalidate because project 5b576544d46f4547ae4b0360cd7a3825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:54:24.870009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.870718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-081c532b-3f82-42ae-ba9c-3dcd09401ae0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:54:24.872281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1204/2405] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:54:24 2022] DELETE /identity/v3/projects/5b576544d46f4547ae4b0360cd7a3825 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:54:34.475532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:54:34.866733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:54:38.184687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:54:38.186732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:38.265466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cfa0f-0ae1-488b-b8ea-4bb4275edb45 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:54:38.330531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:54:38.332474 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:54:38.332786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:54:38.333081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:54:38.335267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:54:38.347681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:54:38.349327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:54:38.360884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1202/2406] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:54:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:54:48.356257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=58 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:55:10.564056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f026a2-bb4c-4700-99c0-398ac1b9f985 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:55:10.564613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f026a2-bb4c-4700-99c0-398ac1b9f985 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:55:10.564936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f026a2-bb4c-4700-99c0-398ac1b9f985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:55:10.616790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-61f026a2-bb4c-4700-99c0-398ac1b9f985 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:55:10.618168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-61f026a2-bb4c-4700-99c0-398ac1b9f985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:55:10.694261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1205/2407] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:55:10 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:55:10.740796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:55:10.742198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:55:10.833924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4700397-8ce2-4c89-b84d-ed54d1221231 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:55:10.839138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:55:10.839790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:55:10.840084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:55:10.840369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:55:10.848740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:55:10.850323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:55:10.858506 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1203/2408] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:55:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:55:20.691429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=43 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:55:20.855297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=41 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:55:22.731543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8e8fb-b5f0-488c-8973-05b193ca8429 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:55:22.732011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8e8fb-b5f0-488c-8973-05b193ca8429 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:55:22.732115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8e8fb-b5f0-488c-8973-05b193ca8429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:55:22.753652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7df8e8fb-b5f0-488c-8973-05b193ca8429 None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:55:22.754860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7df8e8fb-b5f0-488c-8973-05b193ca8429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:55:22.768306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1206/2409] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 30 12:55:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:55:22.781370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:55:22.791899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61b73b2-735b-42db-b536-f026f8923036 service swift] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:55:22.797078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71651a18-5dc4-4b41-b3e2-e3b2aa200f42 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:55:22.797719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651a18-5dc4-4b41-b3e2-e3b2aa200f42 service swift] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:55:22.798010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651a18-5dc4-4b41-b3e2-e3b2aa200f42 service swift] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:55:22.798295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71651a18-5dc4-4b41-b3e2-e3b2aa200f42 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:55:22.806372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71651a18-5dc4-4b41-b3e2-e3b2aa200f42 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:55:22.807955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71651a18-5dc4-4b41-b3e2-e3b2aa200f42 service swift] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:55:22.817117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1204/2410] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:55:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:55:24.061485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fabdc7-01e5-4f93-adcf-64a000eeb9b7 None None] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:55:24.062547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fabdc7-01e5-4f93-adcf-64a000eeb9b7 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:55:24.062664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fabdc7-01e5-4f93-adcf-64a000eeb9b7 None None] PATH_INFO: `/` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:55:24.063974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1207/2411] 10.222.0.20 () {54 vars in 912 bytes} [Thu Jun 30 12:55:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:55:24.070259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:55:24.070779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:55:24.071910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:55:24.090720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:55:24.092092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:55:24.101527 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1205/2412] 10.222.0.20 () {58 vars in 1009 bytes} [Thu Jun 30 12:55:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:55:24.124899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fabdc7-01e5-4f93-adcf-64a000eeb9b7 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:55:24.126852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-72fabdc7-01e5-4f93-adcf-64a000eeb9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:55:24.144691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fabdc7-01e5-4f93-adcf-64a000eeb9b7 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:55:24.149897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f635d-d646-44be-9631-4613af2473cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:55:24.150547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f635d-d646-44be-9631-4613af2473cd service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:55:24.150838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f635d-d646-44be-9631-4613af2473cd service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:55:24.151119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f635d-d646-44be-9631-4613af2473cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:55:24.160692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f635d-d646-44be-9631-4613af2473cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:55:24.162367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f635d-d646-44be-9631-4613af2473cd service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:55:24.172913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1208/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:55:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:55:34.085803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=9 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:55:34.168436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=9 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:56:41.590197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:56:41.591616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:56:41.653541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab42e26-dd09-40b0-95e3-984da3f8dc12 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:56:41.657164 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:56:41.657809 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:56:41.658095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:56:41.658374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:56:41.661307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:56:41.720906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:56:41.722857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:56:41.731976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1206/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:56:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:56:42.923158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f635d-d646-44be-9631-4613af2473cd service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:56:42.924597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-381f635d-d646-44be-9631-4613af2473cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:56:42.937620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f635d-d646-44be-9631-4613af2473cd service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:56:42.941222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:56:42.950755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:56:42.950992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:56:42.951280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:56:42.953181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:56:43.018513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:56:43.020350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:56:43.029876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1209/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:56:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:56:50.865803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:56:50.874348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6989a17-b4b8-472b-aad6-2992812a9b66 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:56:50.877881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:56:50.878513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:56:50.879461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:56:50.879952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:56:50.881788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:56:50.940045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:56:50.942454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:56:50.951616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1207/2416] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:56:50 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:56:53.025553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=28 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:57:00.947345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=76 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:57:33.894299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:57:33.896064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:57:33.956908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6657c01-74f9-4b10-ab56-485c0a82acd1 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:57:33.960158 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:57:33.961947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:57:33.962233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:57:33.962514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:57:33.964351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:57:33.974329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:57:33.975780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:57:33.985187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1210/2417] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:57:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:57:43.981522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=26 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:03.066122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:03.074915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7414147-63cf-4634-81f2-a3d6451d1486 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:03.078494 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:03.079142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:03.079411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:03.079687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:03.081466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:03.140063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:03.141528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:03.151139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1208/2418] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:13.146460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=28 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:24.508269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:24.517434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a9587-75e4-40d4-b2a9-b789bb329b09 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:24.521435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:24.522166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:24.522461 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:24.522749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:24.524568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:24.611078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:24.612473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:24.634204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1211/2419] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:25.486306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:25.488403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:25.507040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5d1f8-033c-4c6a-9e4e-05fa18a4a26f service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:25.513653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823982e9-d448-4f4d-88f1-5a38a230617d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:25.514326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823982e9-d448-4f4d-88f1-5a38a230617d service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:25.514620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823982e9-d448-4f4d-88f1-5a38a230617d service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:25.514945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823982e9-d448-4f4d-88f1-5a38a230617d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:25.517113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-823982e9-d448-4f4d-88f1-5a38a230617d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:25.533451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823982e9-d448-4f4d-88f1-5a38a230617d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:25.535059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823982e9-d448-4f4d-88f1-5a38a230617d service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:25.548529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1209/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:26.918318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:26.927214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43554939-da52-4c69-8f03-3912751b26e6 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:26.935299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c25cfe-0078-4cf5-9100-03b4ed93d94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:26.935299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c25cfe-0078-4cf5-9100-03b4ed93d94e service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:26.935299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c25cfe-0078-4cf5-9100-03b4ed93d94e service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:26.935299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c25cfe-0078-4cf5-9100-03b4ed93d94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:26.935678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-81c25cfe-0078-4cf5-9100-03b4ed93d94e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:26.998211 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c25cfe-0078-4cf5-9100-03b4ed93d94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:26.999664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c25cfe-0078-4cf5-9100-03b4ed93d94e service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:27.009447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1212/2421] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:30.712275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21392578-b4cc-44c2-9d6e-b93574c32b3f None None] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:30.712812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21392578-b4cc-44c2-9d6e-b93574c32b3f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:30.713166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21392578-b4cc-44c2-9d6e-b93574c32b3f None None] PATH_INFO: `/` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:30.714644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1210/2422] 10.222.0.20 () {54 vars in 921 bytes} [Thu Jun 30 12:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 30 12:58:30.724153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:30.725363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:30.725363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:30.745272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] MFA Rules not processed for user `fb592cacc3b1469fb6e64254f1fcf285`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:58:30.746604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:30.755369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1213/2423] 10.222.0.20 () {58 vars in 1018 bytes} [Thu Jun 30 12:58:30 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 12:58:30.781097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21392578-b4cc-44c2-9d6e-b93574c32b3f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:30.795715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:30.796354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21392578-b4cc-44c2-9d6e-b93574c32b3f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:30.797342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:30.801914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:30.803356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:30.803926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:30.803926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:30.813176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:30.813501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3889a47e-5698-4cb3-8f6e-b2a27b5b5f25 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:30.814961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:30.819051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:30.819932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:30.820256 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:30.820587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] PATH_INFO: `/v3/users/07e1ed7064424abdbbd04cdf0b030fd0` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:30.822010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07e1ed7064424abdbbd04cdf0b030fd0)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:30.824008 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:30.826362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1211/2424] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:30.876809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07e1ed7064424abdbbd04cdf0b030fd0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:30.878488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:30.886783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07e1ed7064424abdbbd04cdf0b030fd0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:30.887731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07e1ed7064424abdbbd04cdf0b030fd0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:30.888417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07e1ed7064424abdbbd04cdf0b030fd0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:30.901590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-52940a6b-ebb6-47c5-a6ca-1c6d99602d14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07e1ed7064424abdbbd04cdf0b030fd0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:30.914501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1214/2425] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 12:58:30 2022] DELETE /identity/v3/users/07e1ed7064424abdbbd04cdf0b030fd0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:58:31.092548 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.106543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e5d76c-488a-4f24-907c-90b8d9e1bcab service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.175713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.176525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.176814 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.177094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] PATH_INFO: `/v3/projects/38125a9a5263421ab2a95d71f423bc96` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.178821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] RBAC: Authorizing `identity:delete_project(project_id=38125a9a5263421ab2a95d71f423bc96)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.180807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.229144 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38125a9a5263421ab2a95d71f423bc96', 'request_id': 'req-4a9a80c8-9ea9-4234-b560-d7a9c412cced'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:31.236679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38125a9a5263421ab2a95d71f423bc96', 'request_id': 'req-4a9a80c8-9ea9-4234-b560-d7a9c412cced'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:31.249972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38125a9a5263421ab2a95d71f423bc96', 'request_id': 'req-4a9a80c8-9ea9-4234-b560-d7a9c412cced'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:31.261331 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] The token cache is being invalidate because project 38125a9a5263421ab2a95d71f423bc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 12:58:31.261618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:31.262269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4a9a80c8-9ea9-4234-b560-d7a9c412cced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 12:58:31.263795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1212/2426] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 12:58:31 2022] DELETE /identity/v3/projects/38125a9a5263421ab2a95d71f423bc96 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 12:58:31.270079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3158b-5c50-4f8e-b679-756c49dff97d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.270451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3158b-5c50-4f8e-b679-756c49dff97d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.270831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa3158b-5c50-4f8e-b679-756c49dff97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.290641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1aa3158b-5c50-4f8e-b679-756c49dff97d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:58:31.291865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1aa3158b-5c50-4f8e-b679-756c49dff97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:31.351825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1215/2427] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:58:31.359726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc268e-c1b0-4086-89a3-31f7449eddaf None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.360016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc268e-c1b0-4086-89a3-31f7449eddaf None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.360317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc268e-c1b0-4086-89a3-31f7449eddaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.379064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-ffbc268e-c1b0-4086-89a3-31f7449eddaf None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:58:31.380284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ffbc268e-c1b0-4086-89a3-31f7449eddaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:31.388773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1213/2428] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:58:31.392973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3158b-5c50-4f8e-b679-756c49dff97d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.403803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa3158b-5c50-4f8e-b679-756c49dff97d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.408515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.409178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.409469 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.409756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.410491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 12:58:31.410820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.413236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.424984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1216/2429] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 12:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 12:58:31.429342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc268e-c1b0-4086-89a3-31f7449eddaf None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.438436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc268e-c1b0-4086-89a3-31f7449eddaf None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.443226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.443876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.444163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.444473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.445163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.447064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.482825 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1214/2430] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 12:58:31 2022] POST /identity/v3/projects => generated 391 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:58:31.485878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.495853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387ccf34-5959-4a2b-b4bd-704f1497efca admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.568034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.568762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.569039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.569322 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.570029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.571990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.598582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1217/2431] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 12:58:31 2022] POST /identity/v3/users => generated 296 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 12:58:31.604208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.614682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b7d44-e942-478a-a52b-0e41ef1466c4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.619908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.620608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.620897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.621182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.621907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.623499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.634671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1215/2432] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 12:58:31.639074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.651056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6e13e-b208-43f3-9d37-59aed7b0ef7e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.660397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a89b75-8261-412a-9ee9-4fb6dc3dae7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.661081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89b75-8261-412a-9ee9-4fb6dc3dae7e admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.661380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89b75-8261-412a-9ee9-4fb6dc3dae7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.661688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a89b75-8261-412a-9ee9-4fb6dc3dae7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.662491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a89b75-8261-412a-9ee9-4fb6dc3dae7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.664122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a89b75-8261-412a-9ee9-4fb6dc3dae7e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.674854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1218/2433] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 12:58:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 12:58:31.679156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.689038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd50fbc-a810-4bc7-9e77-19a5bf410376 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.694167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.695057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.695336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.695611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] PATH_INFO: `/v3/projects/1c5bc924527849c8b245b9ac8ddd3ae5/users/be9b3ba4c893462fa73d238823f80258/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.707999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:31.713057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5bc924527849c8b245b9ac8ddd3ae5, user_id=be9b3ba4c893462fa73d238823f80258, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.716191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.730267 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1216/2434] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 12:58:31 2022] PUT /identity/v3/projects/1c5bc924527849c8b245b9ac8ddd3ae5/users/be9b3ba4c893462fa73d238823f80258/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 12:58:31.735479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05238-a87c-4ee2-bd98-ec526aaecaa1 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.736061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05238-a87c-4ee2-bd98-ec526aaecaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.736061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a05238-a87c-4ee2-bd98-ec526aaecaa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.753749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b9a05238-a87c-4ee2-bd98-ec526aaecaa1 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:58:31.754959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b9a05238-a87c-4ee2-bd98-ec526aaecaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:31.781483 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:31.817086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1219/2435] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:58:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:58:31.827292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:31.829268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:31.891231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a153a1-3768-48d8-88de-95385c123f59 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:31.895165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577fd51-7536-4974-857f-f12ee153c74e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:31.895805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577fd51-7536-4974-857f-f12ee153c74e service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:31.896831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577fd51-7536-4974-857f-f12ee153c74e service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:31.897305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577fd51-7536-4974-857f-f12ee153c74e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:31.906361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577fd51-7536-4974-857f-f12ee153c74e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:31.907855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577fd51-7536-4974-857f-f12ee153c74e service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:31.917831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1217/2436] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:36.003933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:36.004489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:36.004585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:36.033900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] MFA Rules not processed for user `be9b3ba4c893462fa73d238823f80258`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:58:36.035206 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:36.123195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1220/2437] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:58:36.133979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:36.134451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:36.134536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:36.159197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] MFA Rules not processed for user `be9b3ba4c893462fa73d238823f80258`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:58:36.160444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:36.178052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1218/2438] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:58:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:58:36.190882 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:36.194612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:36.285265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4178b7a8-b1cc-4791-86d2-614b4c6bfc56 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:36.292325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:36.293128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:36.293598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:36.293877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:36.302852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:36.304635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:36.318670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1221/2439] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:58:36.710052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:36.711573 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:36.723979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f86aa42-b253-477e-92bb-f6fcd5726234 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:36.728567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:36.729302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:36.729667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:36.730026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:36.731950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:36.743041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:36.744531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:36.753422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1219/2440] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:36 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:58:37.110820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:37.112343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:37.120325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:37.129732 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8acd7c-b44e-4232-b7f5-d9073d74ac90 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:37.139198 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91083c0-9594-4172-b126-23339a1e08a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:37.140042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91083c0-9594-4172-b126-23339a1e08a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:37.140468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91083c0-9594-4172-b126-23339a1e08a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:37.140753 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91083c0-9594-4172-b126-23339a1e08a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:37.143214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e91083c0-9594-4172-b126-23339a1e08a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:37.161596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91083c0-9594-4172-b126-23339a1e08a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:37.163279 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91083c0-9594-4172-b126-23339a1e08a6 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:37.173341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:37.178157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1220/2441] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 12:58:37.199424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5433e7-4f90-4137-868f-c62ee4b0b110 service nova] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:37.205806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:37.206474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:37.206763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:37.207045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:37.210330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:37.228556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:37.230497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:37.249532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1222/2442] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:37.259558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767bd7a-2b32-45fb-a74a-43a2ec71c15f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:37.259850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767bd7a-2b32-45fb-a74a-43a2ec71c15f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:37.260133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1767bd7a-2b32-45fb-a74a-43a2ec71c15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:37.278941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-1767bd7a-2b32-45fb-a74a-43a2ec71c15f None None] MFA Rules not processed for user `be9b3ba4c893462fa73d238823f80258`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:58:37.280165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1767bd7a-2b32-45fb-a74a-43a2ec71c15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:37.288479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1221/2443] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:58:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:58:41.521188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:41.522943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:41.541380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ea0ed-d446-4cf9-bfc9-bdc7047ae23c service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:41.547400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c924663-85bb-4482-908d-78355b3cddd7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:41.548064 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924663-85bb-4482-908d-78355b3cddd7 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:41.548350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924663-85bb-4482-908d-78355b3cddd7 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:41.548652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c924663-85bb-4482-908d-78355b3cddd7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:41.553801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2c924663-85bb-4482-908d-78355b3cddd7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:41.570902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c924663-85bb-4482-908d-78355b3cddd7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:41.572616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c924663-85bb-4482-908d-78355b3cddd7 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:41.584919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1223/2444] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:46.162077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767bd7a-2b32-45fb-a74a-43a2ec71c15f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:58:46.176537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1767bd7a-2b32-45fb-a74a-43a2ec71c15f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:58:46.183148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:58:46.183893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:58:46.184319 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:58:46.184643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:58:46.186495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:58:46.200297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:58:46.201894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:58:46.213305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1222/2445] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:58:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:58:51.580035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=17 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:58:56.208585 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=53,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:59:41.638382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e618d-4e90-4042-b122-1b5816628c4a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:59:41.638986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e618d-4e90-4042-b122-1b5816628c4a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:59:41.638986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e618d-4e90-4042-b122-1b5816628c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:59:41.657356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-186e618d-4e90-4042-b122-1b5816628c4a None None] MFA Rules not processed for user `be9b3ba4c893462fa73d238823f80258`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:59:41.658565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-186e618d-4e90-4042-b122-1b5816628c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:59:41.666264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1224/2446] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 12:59:41 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:59:42.760614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:59:42.773291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1efed4c-2135-4d45-a156-d4275469752b service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:59:42.779291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:59:42.780013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:59:42.780368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:59:42.780746 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:59:42.782790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:59:42.796031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:59:42.797659 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:59:42.809119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1223/2447] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:59:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:51.652112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:59:52.804643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=6 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 12:59:53.124062 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bd910-2c93-487d-80b6-55f53a5c368d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:59:53.124616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bd910-2c93-487d-80b6-55f53a5c368d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:59:53.124708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940bd910-2c93-487d-80b6-55f53a5c368d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:59:53.144558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-940bd910-2c93-487d-80b6-55f53a5c368d None None] MFA Rules not processed for user `8ffd5ef5211d42f8b7ba6000166d1a41`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 12:59:53.146358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-940bd910-2c93-487d-80b6-55f53a5c368d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:59:53.201911 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1225/2448] 10.222.0.20 () {58 vars in 967 bytes} [Thu Jun 30 12:59:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 12:59:53.257921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:59:53.259370 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:59:53.332905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff87e19-5699-4a25-8deb-03c80d6bcb96 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:59:53.339241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'addf74dd6b6f4f78bace4808bf676acc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:59:53.339988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:59:53.340349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:59:53.340669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:59:53.349467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:59:53.351065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:59:53.359513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1224/2449] 10.222.0.20 () {60 vars in 1384 bytes} [Thu Jun 30 12:59:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 30 12:59:53.801421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bd910-2c93-487d-80b6-55f53a5c368d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:59:53.812758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940bd910-2c93-487d-80b6-55f53a5c368d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:59:53.816320 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:59:53.817260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:59:53.818042 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:59:53.818341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:59:53.821660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:59:53.835133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:59:53.836603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:59:53.846937 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1226/2450] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:59:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 12:59:57.292493 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 12:59:57.303624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbc181-a081-4b29-a2e4-c2ebfb2e8e99 service swift] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 12:59:57.308555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 12:59:57.309197 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 12:59:57.309481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 12:59:57.309760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 12:59:57.311514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 12:59:57.324298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 12:59:57.325923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 12:59:57.345458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1225/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 12:59:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:00:00.401593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:00.402988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:00.421399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1291e7e7-11d3-4082-9c84-0b7193f1086b service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:00.428100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:00.429260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:00.429878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:00.430372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] PATH_INFO: `/v3/users/4e982914a4104a23866e8c059d52f453` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:00.431639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e982914a4104a23866e8c059d52f453)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:00.433755 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:00.492504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e982914a4104a23866e8c059d52f453'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.499978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e982914a4104a23866e8c059d52f453'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.500625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e982914a4104a23866e8c059d52f453'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.501244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e982914a4104a23866e8c059d52f453'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.515323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e982914a4104a23866e8c059d52f453'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.528131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1227/2452] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:00:00 2022] DELETE /identity/v3/users/4e982914a4104a23866e8c059d52f453 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:00.718469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:00.730285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144a4a-8800-4e49-80d5-ad873c1eb007 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:00.792295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:00.793171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:00.793455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:00.793730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] PATH_INFO: `/v3/projects/b92ca46975cb4975b4e8d98ac15c156f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:00.794905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b92ca46975cb4975b4e8d98ac15c156f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:00.796835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:00.843417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b92ca46975cb4975b4e8d98ac15c156f', 'request_id': 'req-9dba5985-c417-499f-a7c6-142c41d58031'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.851120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b92ca46975cb4975b4e8d98ac15c156f', 'request_id': 'req-9dba5985-c417-499f-a7c6-142c41d58031'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.857387 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b92ca46975cb4975b4e8d98ac15c156f', 'request_id': 'req-9dba5985-c417-499f-a7c6-142c41d58031'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.869608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] The token cache is being invalidate because project b92ca46975cb4975b4e8d98ac15c156f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:00:00.869898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.870547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:00.872076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1226/2453] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:00:00 2022] DELETE /identity/v3/projects/b92ca46975cb4975b4e8d98ac15c156f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:00.876183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:00.877633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:00.891232 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f63682-98fe-4750-8017-f2517b50ef5a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:00.949372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:00.950167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:00.950450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:00.950727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] PATH_INFO: `/v3/users/9647749bbdc04294b6d5ba74db924189` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:00.951972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9647749bbdc04294b6d5ba74db924189)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:00.953997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:00.958787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:01.006044 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9647749bbdc04294b6d5ba74db924189'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.013179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9647749bbdc04294b6d5ba74db924189'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.013823 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9647749bbdc04294b6d5ba74db924189'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.014438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9647749bbdc04294b6d5ba74db924189'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.027514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-cdb284ae-939d-4036-be4c-5fbfdc60060e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9647749bbdc04294b6d5ba74db924189'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.043228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1228/2454] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:00:00 2022] DELETE /identity/v3/users/9647749bbdc04294b6d5ba74db924189 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:01.230177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.231209 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:01.247775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dba5985-c417-499f-a7c6-142c41d58031 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.252273 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:01.310550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:01.311413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.311703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.311982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] PATH_INFO: `/v3/projects/7ed00f1f031849ef99a4350e161076ed` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.313201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ed00f1f031849ef99a4350e161076ed)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:01.315115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:01.363249 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ed00f1f031849ef99a4350e161076ed', 'request_id': 'req-184ae733-aa03-47f2-ac02-df37293ce8f9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.371616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ed00f1f031849ef99a4350e161076ed', 'request_id': 'req-184ae733-aa03-47f2-ac02-df37293ce8f9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.377399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ed00f1f031849ef99a4350e161076ed', 'request_id': 'req-184ae733-aa03-47f2-ac02-df37293ce8f9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.389353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] The token cache is being invalidate because project 7ed00f1f031849ef99a4350e161076ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:00:01.389648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.390292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-184ae733-aa03-47f2-ac02-df37293ce8f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:01.391821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1227/2455] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:00:01 2022] DELETE /identity/v3/projects/7ed00f1f031849ef99a4350e161076ed => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:01.397291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f67e0-5d5f-48d1-9eb7-38af7ae361e8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.397587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f67e0-5d5f-48d1-9eb7-38af7ae361e8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.397872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f67e0-5d5f-48d1-9eb7-38af7ae361e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.416510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-d26f67e0-5d5f-48d1-9eb7-38af7ae361e8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:00:01.417724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d26f67e0-5d5f-48d1-9eb7-38af7ae361e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:01.479810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1229/2456] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:00:01.487374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4ca6-be2c-40ec-ad61-681e367f1e71 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.487667 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4ca6-be2c-40ec-ad61-681e367f1e71 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.487950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdad4ca6-be2c-40ec-ad61-681e367f1e71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.508087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bdad4ca6-be2c-40ec-ad61-681e367f1e71 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:00:01.509345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bdad4ca6-be2c-40ec-ad61-681e367f1e71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:01.517735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1228/2457] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:00:01.522414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f67e0-5d5f-48d1-9eb7-38af7ae361e8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.532164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f67e0-5d5f-48d1-9eb7-38af7ae361e8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.537310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:01.537965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.538246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.538525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.539249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:00:01.539558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:01.541181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:01.553338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1230/2458] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:00:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:00:01.557985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad4ca6-be2c-40ec-ad61-681e367f1e71 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.568322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdad4ca6-be2c-40ec-ad61-681e367f1e71 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.573095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:01.573760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.574050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.574333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.575031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:01.577018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:01.607917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1229/2459] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:00:01 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:00:01.612377 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.623516 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bbc36-fd9a-49d0-9fd8-cef20000e22f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.684428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:01.685120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.685412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.685697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.686401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:01.688398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:01.710317 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:01.719165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1231/2460] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:00:01 2022] POST /identity/v3/users => generated 286 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:00:01.720458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.732258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8d680b-4498-4709-9642-5015214e1bca admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.736862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:01.737526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.737813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.738096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.738822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:01.741475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:01.751866 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1230/2461] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:00:01.756701 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.767050 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc0dae1-eb0f-4af9-9e95-821e98d94b49 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.772170 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18944258-ca1b-4ce6-8b9c-3f0de72fbf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:01.772868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18944258-ca1b-4ce6-8b9c-3f0de72fbf9e admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.773159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18944258-ca1b-4ce6-8b9c-3f0de72fbf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.773439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18944258-ca1b-4ce6-8b9c-3f0de72fbf9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.774172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18944258-ca1b-4ce6-8b9c-3f0de72fbf9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:01.775787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18944258-ca1b-4ce6-8b9c-3f0de72fbf9e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:01.785973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1232/2462] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:00:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:00:01.789946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.799998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9527677e-303c-450b-aa16-864013c62c6b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.805477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:01.806364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.806767 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.807057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] PATH_INFO: `/v3/projects/d25cbada7c7d41609d67c49436243df6/users/c177e713d38746a78fe556fc5d166591/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.822603 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25cbada7c7d41609d67c49436243df6, user_id=c177e713d38746a78fe556fc5d166591, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:01.825291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:01.838393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1231/2463] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:00:01 2022] PUT /identity/v3/projects/d25cbada7c7d41609d67c49436243df6/users/c177e713d38746a78fe556fc5d166591/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:01.843449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce815c3-11fb-4178-ba08-2531cf0092f9 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:01.843742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce815c3-11fb-4178-ba08-2531cf0092f9 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:01.844023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce815c3-11fb-4178-ba08-2531cf0092f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:01.861486 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9ce815c3-11fb-4178-ba08-2531cf0092f9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:00:01.862698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9ce815c3-11fb-4178-ba08-2531cf0092f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:01.922935 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1233/2464] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:00:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:00:01.934098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:01.935806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:01.971375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:01.995774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced4d287-d0fc-4669-b356-5db64ea7a2be admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:01.999411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:02.000056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:02.000344 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:02.000653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:02.010304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:02.011770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:02.022072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1232/2465] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:00:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:00:06.169339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e312f-c3ed-4e51-a8f4-c60700bf0569 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:06.169788 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e312f-c3ed-4e51-a8f4-c60700bf0569 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:06.170334 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762e312f-c3ed-4e51-a8f4-c60700bf0569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:06.201357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-762e312f-c3ed-4e51-a8f4-c60700bf0569 None None] MFA Rules not processed for user `c177e713d38746a78fe556fc5d166591`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:00:06.202808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-762e312f-c3ed-4e51-a8f4-c60700bf0569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:06.273648 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1234/2466] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:00:06 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:00:06.278252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:06.288451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ad40d4-73aa-42b3-8129-6d2df56efe82 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:06.293153 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:06.293830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:06.294119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:06.294403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:06.295111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:06.297080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:06.325914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1233/2467] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:00:06 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:00:06.330385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e312f-c3ed-4e51-a8f4-c60700bf0569 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:06.342550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762e312f-c3ed-4e51-a8f4-c60700bf0569 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:06.414790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:06.415490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:06.415774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:06.416052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:06.416859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:06.418810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:06.442291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1235/2468] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:00:06 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:00:06.446946 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:06.457544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ec5601-b4bb-4f7a-aa06-d4d5204a0354 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:06.463430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:06.464134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:06.464449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:06.464733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:06.465464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:06.467114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:06.482520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1234/2469] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:00:06.483720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:06.495754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd60ad2-24d1-42b6-8663-2237d79e8269 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:06.502579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:06.503496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:06.503790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:06.504075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] PATH_INFO: `/v3/projects/6b8bd46804384fb4b87a2de4c6e940ba/users/fc1bb8ea4e874982a1688f8311b69d93/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:06.508277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:06.523888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8bd46804384fb4b87a2de4c6e940ba, user_id=fc1bb8ea4e874982a1688f8311b69d93, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:06.526704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:06.540735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1236/2470] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:00:06 2022] PUT /identity/v3/projects/6b8bd46804384fb4b87a2de4c6e940ba/users/fc1bb8ea4e874982a1688f8311b69d93/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:06.544646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:06.555745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f02576-4b72-4043-a1d8-8e15025eaa5d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:06.625821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59759a17-39d9-48fe-b2c8-e3dffb374e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:06.627458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759a17-39d9-48fe-b2c8-e3dffb374e8f admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:06.627458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759a17-39d9-48fe-b2c8-e3dffb374e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:06.627458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59759a17-39d9-48fe-b2c8-e3dffb374e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:06.629317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59759a17-39d9-48fe-b2c8-e3dffb374e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:06.629944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59759a17-39d9-48fe-b2c8-e3dffb374e8f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:06.647433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1235/2471] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:00:06 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:00:06.651370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:06.663020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7751e5e2-c6e5-4089-a126-8ff1311ca427 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:06.668145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:06.669074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:06.669366 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:06.669760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] PATH_INFO: `/v3/projects/6b8bd46804384fb4b87a2de4c6e940ba/users/fc1bb8ea4e874982a1688f8311b69d93/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:06.671779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b8bd46804384fb4b87a2de4c6e940ba, user_id=fc1bb8ea4e874982a1688f8311b69d93, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:06.674482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:06.686342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1237/2472] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:00:06 2022] PUT /identity/v3/projects/6b8bd46804384fb4b87a2de4c6e940ba/users/fc1bb8ea4e874982a1688f8311b69d93/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:00:11.263254 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146983-28fd-4a38-8cc4-8f63452860c0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:11.263728 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146983-28fd-4a38-8cc4-8f63452860c0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:11.263818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44146983-28fd-4a38-8cc4-8f63452860c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:11.293300 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-44146983-28fd-4a38-8cc4-8f63452860c0 None None] MFA Rules not processed for user `fc1bb8ea4e874982a1688f8311b69d93`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:00:11.294634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-44146983-28fd-4a38-8cc4-8f63452860c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:11.365987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1236/2473] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:00:11 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:00:11.383492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:11.385376 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:11.466143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4948a138-3f8d-4af8-b03b-d61cf4d2cb6a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:11.471676 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:11.472343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:11.472669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:11.472956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:11.551416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:11.553150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:11.565259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1238/2474] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:00:11 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:00:12.623905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46547-3cbe-4861-a563-8d5eec52325b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:12.624496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46547-3cbe-4861-a563-8d5eec52325b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:12.624595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c46547-3cbe-4861-a563-8d5eec52325b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:12.644107 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e5c46547-3cbe-4861-a563-8d5eec52325b None None] MFA Rules not processed for user `c177e713d38746a78fe556fc5d166591`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:00:12.645447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e5c46547-3cbe-4861-a563-8d5eec52325b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:12.653146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1237/2475] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:00:12 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:00:21.565700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=67,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:22.637738 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:26.044726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:26.046182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:26.103289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69e78c8-f008-4b35-8433-9fbd2a893310 service nova] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:26.107854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:26.108541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:26.108838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:26.109123 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:26.110951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:26.121390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:26.122853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:26.130876 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1239/2476] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:00:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:00:33.613982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c46547-3cbe-4861-a563-8d5eec52325b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:33.686729 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c46547-3cbe-4861-a563-8d5eec52325b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:33.694341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:33.695504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:33.696206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:33.696930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] PATH_INFO: `/v3/users/c177e713d38746a78fe556fc5d166591` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:33.699242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c177e713d38746a78fe556fc5d166591)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:33.702301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:33.757171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c177e713d38746a78fe556fc5d166591'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:33.768810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c177e713d38746a78fe556fc5d166591'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:33.783419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c177e713d38746a78fe556fc5d166591'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:33.784188 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c177e713d38746a78fe556fc5d166591'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:33.792593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c177e713d38746a78fe556fc5d166591'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:33.799286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1238/2477] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:00:33 2022] DELETE /identity/v3/users/c177e713d38746a78fe556fc5d166591 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:00:34.158033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:34.178838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed887b0a-3e22-4dd5-acc7-7e3a9e3ef158 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:34.287107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:34.289318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:34.290371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:34.290673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] PATH_INFO: `/v3/projects/d25cbada7c7d41609d67c49436243df6` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:34.297589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25cbada7c7d41609d67c49436243df6)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:34.299956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:34.375240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25cbada7c7d41609d67c49436243df6', 'request_id': 'req-b7fd7bcc-ede2-449f-b24c-f3291a10d880'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.382031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25cbada7c7d41609d67c49436243df6', 'request_id': 'req-b7fd7bcc-ede2-449f-b24c-f3291a10d880'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.391345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25cbada7c7d41609d67c49436243df6', 'request_id': 'req-b7fd7bcc-ede2-449f-b24c-f3291a10d880'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.407995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] The token cache is being invalidate because project d25cbada7c7d41609d67c49436243df6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:00:34.408293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.409011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.410797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1240/2478] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:00:34 2022] DELETE /identity/v3/projects/d25cbada7c7d41609d67c49436243df6 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:34.414462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:34.417139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:34.432078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ce4c08-501e-421a-b9ee-0a05960227b9 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:34.500804 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:34.502012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:34.502303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:34.502579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] PATH_INFO: `/v3/users/fc1bb8ea4e874982a1688f8311b69d93` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:34.503815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc1bb8ea4e874982a1688f8311b69d93)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:34.505913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:34.538684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:34.575514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc1bb8ea4e874982a1688f8311b69d93'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.586159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc1bb8ea4e874982a1688f8311b69d93'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.607337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc1bb8ea4e874982a1688f8311b69d93'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.608363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc1bb8ea4e874982a1688f8311b69d93'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.616472 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc1bb8ea4e874982a1688f8311b69d93'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.626271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1239/2479] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:00:34 2022] DELETE /identity/v3/users/fc1bb8ea4e874982a1688f8311b69d93 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:34.837315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:00:34.839427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:00:34.854562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd7bcc-ede2-449f-b24c-f3291a10d880 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:00:34.890180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:34.920496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:00:34.921403 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:00:34.921693 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:00:34.921978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] PATH_INFO: `/v3/projects/6b8bd46804384fb4b87a2de4c6e940ba` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:00:34.923193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b8bd46804384fb4b87a2de4c6e940ba)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:00:34.925188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:00:34.976106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b8bd46804384fb4b87a2de4c6e940ba', 'request_id': 'req-3a17a382-45c2-4f1c-a238-b130d52a16af'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.983018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b8bd46804384fb4b87a2de4c6e940ba', 'request_id': 'req-3a17a382-45c2-4f1c-a238-b130d52a16af'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:34.990843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b8bd46804384fb4b87a2de4c6e940ba', 'request_id': 'req-3a17a382-45c2-4f1c-a238-b130d52a16af'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:35.001394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] The token cache is being invalidate because project 6b8bd46804384fb4b87a2de4c6e940ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:00:35.001683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:35.002316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:00:35.003869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1241/2480] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:00:34 2022] DELETE /identity/v3/projects/6b8bd46804384fb4b87a2de4c6e940ba => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:00:44.619912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:00:44.998270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=36,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:01:41.791372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:01:41.793503 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:01:41.850025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a44617-f257-4245-b775-dec2c58a3849 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:01:41.897979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:01:41.898625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:01:41.898916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:01:41.899200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:01:41.900980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:01:41.978985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:01:41.980661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:01:41.998613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1240/2481] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:01:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:01:43.771698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:01:43.773155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:01:43.787817 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a17a382-45c2-4f1c-a238-b130d52a16af admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:01:43.791654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:01:43.792697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:01:43.793340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:01:43.793340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:01:43.795138 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:01:43.880222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:01:43.881705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:01:43.901144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1242/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:01:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:01:51.996028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=81 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:01:53.898515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=41 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:02:41.834977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:02:41.836495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:02:41.892839 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f7af0-799e-4dc2-8cc4-be3ba959952e service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:02:41.896744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:02:41.897388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:02:41.897679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:02:41.897962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:02:41.899723 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:02:41.909220 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:02:41.910641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:02:41.918562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1241/2483] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:02:41 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:02:51.915048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=26 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:03:36.739712 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:03:36.741168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:03:36.752613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b755be-3cdf-4ed7-ab29-632fd19e5027 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:03:36.756223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:03:36.756905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:03:36.757198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:03:36.757480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:03:36.759217 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:03:36.820363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:03:36.821841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:03:36.830798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1243/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:03:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:03:46.826716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=28 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:05:41.141497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:05:41.142891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:41.281518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c393aa65-4396-497b-aece-5b499727969e service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:05:41.286567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:05:41.287215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:05:41.288108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:05:41.288684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:05:41.290307 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:05:41.301552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:05:41.303322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:05:41.313238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1242/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:05:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:05:51.308980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=63 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:37.382994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:37.384494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:37.436924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e19334-8b01-4443-9b8a-55a672371cde service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:37.440500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:37.441139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:37.441421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:37.441697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:37.443446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:37.519367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:37.520858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:37.532886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1244/2486] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:38.361384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:38.362878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:38.388955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cef4c-f323-4324-a794-3f4ae57dae8c service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:38.396464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:38.397278 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:38.397558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:38.397842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:38.401488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:38.416211 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:38.418530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:38.436863 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1243/2487] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:39.991581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.001024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d368f0f1-6fb9-4b5c-a56d-dd7adf9465b6 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.004881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.005531 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.005852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.006165 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.008010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:40.021832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.023837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.035043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1245/2488] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:40.606392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:40.615827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d38628-d925-4e19-ab67-6ee3cae82699 service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:40.620295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:40.620974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:40.621260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:40.621539 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:40.623398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:40.722604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:40.724059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:40.744351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1244/2489] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:41.731766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:41.751984 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b7e01-eda6-4868-8569-888e794874da service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:41.755730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:41.756413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:41.756740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:41.757025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:41.766728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:41.768199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:41.779005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1246/2490] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:41 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:42.367830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:42.379016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd86ef16-4f03-4c9e-9b55-a667c3a5d5e1 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:42.383396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:42.384157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:42.384485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:42.384773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:42.386719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:42.400515 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:42.402090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:42.412473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1245/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:44.171507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.187722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc45a3c-301d-40d7-9c8e-2ce9fb9fbf10 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.202963 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.203646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.203938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.204223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.206168 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:44.246025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.247885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.248425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.250478 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:44.269175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1247/2492] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:44.274499 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de72a1e-e1f1-4792-a043-88dfecb8d3f8 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.281189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.282264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.282868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.284817 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] PATH_INFO: `/v3/users/fc4e06c1371340a98c2c76457aa74b6a` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.287446 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc4e06c1371340a98c2c76457aa74b6a)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.290654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.384921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc4e06c1371340a98c2c76457aa74b6a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.397383 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc4e06c1371340a98c2c76457aa74b6a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.415180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc4e06c1371340a98c2c76457aa74b6a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.415895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc4e06c1371340a98c2c76457aa74b6a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.424686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a96ba0fc-14c6-4b72-9356-c208c4f1449c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc4e06c1371340a98c2c76457aa74b6a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.439950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1246/2493] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:06:44 2022] DELETE /identity/v3/users/fc4e06c1371340a98c2c76457aa74b6a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:06:44.644758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:44.674446 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb36d5a8-7d0b-4072-bdbd-6483a41409a4 service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:44.743431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.754293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:44.755235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.755585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.755951 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] PATH_INFO: `/v3/projects/c29a54e53a084a14a10879fc00b2a867` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.757243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c29a54e53a084a14a10879fc00b2a867)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:44.759278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:44.809887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c29a54e53a084a14a10879fc00b2a867', 'request_id': 'req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.816153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c29a54e53a084a14a10879fc00b2a867', 'request_id': 'req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.826143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c29a54e53a084a14a10879fc00b2a867', 'request_id': 'req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.837998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] The token cache is being invalidate because project c29a54e53a084a14a10879fc00b2a867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:06:44.838291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.838936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c1f0cf9e-02d2-42c6-b8d3-f996583690c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:44.840547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1248/2494] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:06:44 2022] DELETE /identity/v3/projects/c29a54e53a084a14a10879fc00b2a867 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:44.846876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b25ea-6a7f-4d7e-983f-9634c68cd1b7 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.847242 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b25ea-6a7f-4d7e-983f-9634c68cd1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.847611 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b25ea-6a7f-4d7e-983f-9634c68cd1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.861858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:44.906260 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a29b25ea-6a7f-4d7e-983f-9634c68cd1b7 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:44.907513 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a29b25ea-6a7f-4d7e-983f-9634c68cd1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:44.969867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1247/2495] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:06:44.977318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3074c-a52d-47bc-bca9-f67356e950a8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:44.977609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3074c-a52d-47bc-bca9-f67356e950a8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:44.977890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a3074c-a52d-47bc-bca9-f67356e950a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:44.997268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a7a3074c-a52d-47bc-bca9-f67356e950a8 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:44.999074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a7a3074c-a52d-47bc-bca9-f67356e950a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:45.010378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1249/2496] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:45.014488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b25ea-6a7f-4d7e-983f-9634c68cd1b7 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.025813 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b25ea-6a7f-4d7e-983f-9634c68cd1b7 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.030581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.031324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.031568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.031852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.032636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:45.032923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.034517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.062802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1248/2497] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:45.067411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3074c-a52d-47bc-bca9-f67356e950a8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.078169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a3074c-a52d-47bc-bca9-f67356e950a8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.084131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.085119 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.085264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.086420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.087490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.089592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.119086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1250/2498] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:06:45 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:06:45.123518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.137624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b606ba0a-5c10-4401-addc-a5790da46064 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.211032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.211818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.212013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.212306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.213025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.214952 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.238954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1249/2499] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:06:45 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:45.240436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.251757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e331f97-e5d6-488f-9b05-33fdaafb2cf2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.257824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.260779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.260891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.261144 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.263124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.264803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.279439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1251/2500] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:06:45.281418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.293976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803ab56-c116-4421-ace6-7e0d365e9321 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.299666 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37eb7d40-f36f-4e69-94cb-fb826c3fa3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.300672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7d40-f36f-4e69-94cb-fb826c3fa3f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.300672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7d40-f36f-4e69-94cb-fb826c3fa3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.301004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37eb7d40-f36f-4e69-94cb-fb826c3fa3f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.301674 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb7d40-f36f-4e69-94cb-fb826c3fa3f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.303280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37eb7d40-f36f-4e69-94cb-fb826c3fa3f5 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.316139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1250/2501] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:06:45.321098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.332918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa630b15-0334-49c6-a225-827ac438c68d admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.337754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.338652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.338955 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.339226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] PATH_INFO: `/v3/projects/4e0c064dd8974c069dd8d3afd8b48fb3/users/eaffb1d48ff64ad498e65b3d0bb7677c/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.356613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e0c064dd8974c069dd8d3afd8b48fb3, user_id=eaffb1d48ff64ad498e65b3d0bb7677c, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.359384 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.376106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1252/2502] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:06:45 2022] PUT /identity/v3/projects/4e0c064dd8974c069dd8d3afd8b48fb3/users/eaffb1d48ff64ad498e65b3d0bb7677c/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:06:45.381204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.381504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.381789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.401424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:45.402715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:45.448017 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:45.470301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1251/2503] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:45.480533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.482287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:45.555644 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c99fa-c684-440e-8392-352e213fa6d8 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.559505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.560169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.560538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.560780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.571449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.572944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.584773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1253/2504] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:45.890842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:45.893468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:45.908351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9d6731-25ef-4cdd-a788-ed5107cfae95 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:45.913292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:45.914869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:45.915247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:45.915530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] PATH_INFO: `/v3/users/be9b3ba4c893462fa73d238823f80258` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:45.916861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=be9b3ba4c893462fa73d238823f80258)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:45.918862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:45.977750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be9b3ba4c893462fa73d238823f80258'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:45.985154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be9b3ba4c893462fa73d238823f80258'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.004854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be9b3ba4c893462fa73d238823f80258'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.005672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be9b3ba4c893462fa73d238823f80258'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.014996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b9e670f0-cc5c-4b13-92db-ec91295bd1dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be9b3ba4c893462fa73d238823f80258'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.021141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1252/2505] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:06:45 2022] DELETE /identity/v3/users/be9b3ba4c893462fa73d238823f80258 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:46.390448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:46.407177 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500eac62-cdcd-43ec-a391-be6abf45d4c3 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:46.448573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:46.502040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:46.503212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.503981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.504365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] PATH_INFO: `/v3/projects/1c5bc924527849c8b245b9ac8ddd3ae5` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.505714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5bc924527849c8b245b9ac8ddd3ae5)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:46.508598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:46.566859 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5bc924527849c8b245b9ac8ddd3ae5', 'request_id': 'req-119c84c9-d067-4f95-b8a2-173ef597c21c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.574642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5bc924527849c8b245b9ac8ddd3ae5', 'request_id': 'req-119c84c9-d067-4f95-b8a2-173ef597c21c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.583931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5bc924527849c8b245b9ac8ddd3ae5', 'request_id': 'req-119c84c9-d067-4f95-b8a2-173ef597c21c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.597046 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] The token cache is being invalidate because project 1c5bc924527849c8b245b9ac8ddd3ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:06:46.597451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.598179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-119c84c9-d067-4f95-b8a2-173ef597c21c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:46.600080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1254/2506] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:06:46 2022] DELETE /identity/v3/projects/1c5bc924527849c8b245b9ac8ddd3ae5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:46.607555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a5e4-ddea-4251-a6b8-e365b2a92d06 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.608004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a5e4-ddea-4251-a6b8-e365b2a92d06 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.608128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9319a5e4-ddea-4251-a6b8-e365b2a92d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.630949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9319a5e4-ddea-4251-a6b8-e365b2a92d06 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:46.633518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9319a5e4-ddea-4251-a6b8-e365b2a92d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:46.712510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1253/2507] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:46.720313 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97240a3-0f9d-480d-a6ee-4a4b13497215 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.720727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97240a3-0f9d-480d-a6ee-4a4b13497215 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.721145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97240a3-0f9d-480d-a6ee-4a4b13497215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.745682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a97240a3-0f9d-480d-a6ee-4a4b13497215 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:46.747069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a97240a3-0f9d-480d-a6ee-4a4b13497215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:46.755709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1255/2508] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:46.760044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319a5e4-ddea-4251-a6b8-e365b2a92d06 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:46.770876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9319a5e4-ddea-4251-a6b8-e365b2a92d06 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:46.776899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:46.777587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.777872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.778155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.778895 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:46.779330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:46.781001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:46.793764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1254/2509] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:06:46.798194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97240a3-0f9d-480d-a6ee-4a4b13497215 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:46.808736 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97240a3-0f9d-480d-a6ee-4a4b13497215 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:46.815183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:46.815958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.816311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.816682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.817453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:46.819460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:46.854729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1256/2510] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:06:46 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:06:46.856289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:46.867489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc2f19-5b02-44e5-b2b7-a8c770c6ca95 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:46.917677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:46.939543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:46.940557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.940950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.941416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.942572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:46.944422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:46.972423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1255/2511] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:06:46 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:46.975279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:46.986244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67da16-2888-4297-bcd9-a35d13dac29e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:46.991507 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:46.992305 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:46.993409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:46.993409 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:46.993740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:46.996336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:47.008733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1257/2512] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:06:47.013460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.026628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2c8d3-e4e7-4154-bf8f-5d19b7795d16 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.032501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4052695-87ea-43d0-a4b4-eabdfbb559be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:47.033336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4052695-87ea-43d0-a4b4-eabdfbb559be admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.033632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4052695-87ea-43d0-a4b4-eabdfbb559be admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.033913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4052695-87ea-43d0-a4b4-eabdfbb559be admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.034683 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4052695-87ea-43d0-a4b4-eabdfbb559be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:47.036287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4052695-87ea-43d0-a4b4-eabdfbb559be admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:47.048138 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1256/2513] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:06:47.051994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.062806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5071-2ee6-4d0b-a6c5-16209a123be3 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.067863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:47.068908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.069430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.070350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] PATH_INFO: `/v3/projects/5978ca54c121412b9185a448c0c1e064/users/37c2e7cb102642bfa18234c762d0b7b6/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.087236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5978ca54c121412b9185a448c0c1e064, user_id=37c2e7cb102642bfa18234c762d0b7b6, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:47.090936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:47.107171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1258/2514] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:06:47 2022] PUT /identity/v3/projects/5978ca54c121412b9185a448c0c1e064/users/37c2e7cb102642bfa18234c762d0b7b6/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:47.117244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30536b6-149f-48ce-a25e-a51074dcc051 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.117726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30536b6-149f-48ce-a25e-a51074dcc051 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.118104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30536b6-149f-48ce-a25e-a51074dcc051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.156063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e30536b6-149f-48ce-a25e-a51074dcc051 None None] MFA Rules not processed for user `37c2e7cb102642bfa18234c762d0b7b6`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:47.157726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e30536b6-149f-48ce-a25e-a51074dcc051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:47.239162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1257/2515] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:47.251213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:47.252870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:47.312602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:47.342898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1518be-3c6a-4ecd-8451-dbbc70ab3d87 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:47.346888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:47.347613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:47.347967 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:47.348307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:47.358810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:47.360292 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:47.384266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1259/2516] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:47 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:50.067407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ecfc4-b033-4164-a673-85ea722fc386 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.067865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ecfc4-b033-4164-a673-85ea722fc386 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.067987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34ecfc4-b033-4164-a673-85ea722fc386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.095031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e34ecfc4-b033-4164-a673-85ea722fc386 None None] MFA Rules not processed for user `eaffb1d48ff64ad498e65b3d0bb7677c`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:50.096185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e34ecfc4-b033-4164-a673-85ea722fc386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:50.162122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1258/2517] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:50.176603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:50.178068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:50.278803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aea2a48-e747-45c2-acb2-8a11805a6489 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:50.284481 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:50.285213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:50.285568 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:50.285913 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:50.295841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:50.297474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:50.308602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1260/2518] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:51.816872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:51.817359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:51.817623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:51.836416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] MFA Rules not processed for user `eaffb1d48ff64ad498e65b3d0bb7677c`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:51.837624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:51.845028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1259/2519] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:52.176853 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.179750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:52.242921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40124ca0-f33b-456d-9b4b-081571dacd59 service nova] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.246623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.247471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.247756 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.248033 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.250065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:52.261512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.262961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.271380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1261/2520] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:52.734955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:52.736449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:52.812019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:52.856606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526dfff3-1896-4783-a7a8-1d9791fa0efd None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:52.868109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e538f5-0127-4d1a-9900-a210b320478c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:52.868893 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e538f5-0127-4d1a-9900-a210b320478c service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:52.869194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e538f5-0127-4d1a-9900-a210b320478c service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:52.869485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e538f5-0127-4d1a-9900-a210b320478c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:52.879269 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-29e538f5-0127-4d1a-9900-a210b320478c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:52.893203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e538f5-0127-4d1a-9900-a210b320478c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:52.895074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e538f5-0127-4d1a-9900-a210b320478c service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:52.912662 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1260/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:56.347520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.412979 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9e5e8-6a8e-49ba-85cc-944dbfdb7916 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.417970 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.418969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.419296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.419612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] PATH_INFO: `/v3/users/37c2e7cb102642bfa18234c762d0b7b6` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.420953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c2e7cb102642bfa18234c762d0b7b6)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.422909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.428597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=100 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:56.471845 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c2e7cb102642bfa18234c762d0b7b6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:56.479018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c2e7cb102642bfa18234c762d0b7b6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:56.479626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c2e7cb102642bfa18234c762d0b7b6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:56.480234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c2e7cb102642bfa18234c762d0b7b6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:56.492595 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c2e7cb102642bfa18234c762d0b7b6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:56.504498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1262/2522] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:06:56 2022] DELETE /identity/v3/users/37c2e7cb102642bfa18234c762d0b7b6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:56.509984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.509984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.510438 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.528146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:56.529442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:56.586916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1261/2523] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:56.596608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.598016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:56.654856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09792fcb-dff7-48cc-a314-61a00bcf3157 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.658549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116d4b1a-7981-4d0c-a1c7-dfa0a338677b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.659193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4b1a-7981-4d0c-a1c7-dfa0a338677b service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.659480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4b1a-7981-4d0c-a1c7-dfa0a338677b service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.659761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d4b1a-7981-4d0c-a1c7-dfa0a338677b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.669709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4b1a-7981-4d0c-a1c7-dfa0a338677b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.671191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116d4b1a-7981-4d0c-a1c7-dfa0a338677b service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:56.681032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1263/2524] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:56.966854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:56.968280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:56.980536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac35e9a1-69e7-4df5-bfd4-93f5c0c14d9b None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:56.985175 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:56.986037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:56.986318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:56.986598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] PATH_INFO: `/v3/projects/5978ca54c121412b9185a448c0c1e064` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:56.987791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5978ca54c121412b9185a448c0c1e064)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:56.989717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.035937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5978ca54c121412b9185a448c0c1e064', 'request_id': 'req-09b07fd4-0d3e-4a53-96f8-a7688eade351'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:57.043075 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5978ca54c121412b9185a448c0c1e064', 'request_id': 'req-09b07fd4-0d3e-4a53-96f8-a7688eade351'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:57.049114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5978ca54c121412b9185a448c0c1e064', 'request_id': 'req-09b07fd4-0d3e-4a53-96f8-a7688eade351'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:57.060871 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] The token cache is being invalidate because project 5978ca54c121412b9185a448c0c1e064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:06:57.061167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:57.061833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-09b07fd4-0d3e-4a53-96f8-a7688eade351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:06:57.063395 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1262/2525] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:06:56 2022] DELETE /identity/v3/projects/5978ca54c121412b9185a448c0c1e064 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:57.068265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef18a-f033-4420-a425-1a39a2a9ef44 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.068589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef18a-f033-4420-a425-1a39a2a9ef44 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.068875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbef18a-f033-4420-a425-1a39a2a9ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.089371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9bbef18a-f033-4420-a425-1a39a2a9ef44 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:57.090582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9bbef18a-f033-4420-a425-1a39a2a9ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:57.160406 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1264/2526] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:57.168748 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293351c5-df48-4e4a-9c47-292c68e79d9a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.169072 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293351c5-df48-4e4a-9c47-292c68e79d9a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.169356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293351c5-df48-4e4a-9c47-292c68e79d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.189044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-293351c5-df48-4e4a-9c47-292c68e79d9a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:57.190353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-293351c5-df48-4e4a-9c47-292c68e79d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:57.199189 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1263/2527] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:57.203540 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef18a-f033-4420-a425-1a39a2a9ef44 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.213866 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbef18a-f033-4420-a425-1a39a2a9ef44 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.218555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.219222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.219515 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.219801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.220606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:06:57.220927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.222567 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.234995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1265/2528] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:06:57.239167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293351c5-df48-4e4a-9c47-292c68e79d9a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.251764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293351c5-df48-4e4a-9c47-292c68e79d9a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.256615 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.258043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.258541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.259052 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.260303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.262654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.297431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1264/2529] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:57.298720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.309749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354099e-ad1f-4ec9-958f-22e147ee3001 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.324358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.374708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.375514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.375870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.376221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.377024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.379032 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.400665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1266/2530] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/users => generated 284 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:57.404699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.420794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615d7256-0f7c-424f-95a4-fe6634d1b117 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.426877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.427554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.427849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.428134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.428906 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.431378 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.442425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1265/2531] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:06:57.447210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.457561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d135edb5-05ae-46d2-8c6d-2a110fe99c94 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.463539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d43e81c-4df1-42f8-9f9a-041ed2a03a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.464214 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43e81c-4df1-42f8-9f9a-041ed2a03a7e admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.464539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43e81c-4df1-42f8-9f9a-041ed2a03a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.464824 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d43e81c-4df1-42f8-9f9a-041ed2a03a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.465562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43e81c-4df1-42f8-9f9a-041ed2a03a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.467228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d43e81c-4df1-42f8-9f9a-041ed2a03a7e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.478785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1267/2532] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:06:57.482869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.493430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9472a-1228-4d7a-a85f-707a6612fe02 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.498093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.499007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.499292 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.499570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] PATH_INFO: `/v3/projects/6143739f715647f4b5b7833c1eeda3d8/users/0a9fe96abdf144a6bfe8b344e61fb294/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.508403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.518178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6143739f715647f4b5b7833c1eeda3d8, user_id=0a9fe96abdf144a6bfe8b344e61fb294, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.522165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.547908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1266/2533] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:06:57 2022] PUT /identity/v3/projects/6143739f715647f4b5b7833c1eeda3d8/users/0a9fe96abdf144a6bfe8b344e61fb294/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:57.559124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3132-f198-4742-9c7f-bf4b0a678fd8 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.559428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3132-f198-4742-9c7f-bf4b0a678fd8 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.559719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c3132-f198-4742-9c7f-bf4b0a678fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.588417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0b4c3132-f198-4742-9c7f-bf4b0a678fd8 None None] MFA Rules not processed for user `0a9fe96abdf144a6bfe8b344e61fb294`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:57.589652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0b4c3132-f198-4742-9c7f-bf4b0a678fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:57.656128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1268/2534] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:57.660570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.722032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd6088-f069-47ed-b943-88eca9af13d1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.727374 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.728059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.728346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.728654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.729335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.731229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.756469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1267/2535] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:57.760638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c3132-f198-4742-9c7f-bf4b0a678fd8 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.771899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c3132-f198-4742-9c7f-bf4b0a678fd8 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.829907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.830585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.830872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.831153 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.831858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.833836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.856326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1269/2536] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:06:57 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:06:57.860568 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.871520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dadb5a-540c-49f7-ba80-9b7b236836d5 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.876152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.876847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.877163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.877448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.878174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.879772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.890265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1268/2537] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:06:57.894342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.904508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d6069-383d-4240-ad39-3ae6d776ad07 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:57.909150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:57.910024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:57.910312 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:57.910591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] PATH_INFO: `/v3/projects/560653d439844a0cb6943f66e95c2e32/users/15cad5d953684cdf8c6a610f769c2ff3/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:57.922295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:57.927228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560653d439844a0cb6943f66e95c2e32, user_id=15cad5d953684cdf8c6a610f769c2ff3, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:57.931277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:57.943880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1270/2538] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:06:57 2022] PUT /identity/v3/projects/560653d439844a0cb6943f66e95c2e32/users/15cad5d953684cdf8c6a610f769c2ff3/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:57.947832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:57.957710 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a75efa-91f5-4f46-bd1f-2132161c0d40 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.014800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b1c06-af76-4be1-8811-a437390cde6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.015482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1c06-af76-4be1-8811-a437390cde6d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.015770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1c06-af76-4be1-8811-a437390cde6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.016048 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b1c06-af76-4be1-8811-a437390cde6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.016818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b1c06-af76-4be1-8811-a437390cde6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.018423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b1c06-af76-4be1-8811-a437390cde6d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.032810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1269/2539] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:06:58.033931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.045280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7d1460-c52c-41f1-97d8-9eaec13450a4 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.049946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.050847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.051125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.051382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] PATH_INFO: `/v3/projects/560653d439844a0cb6943f66e95c2e32/users/15cad5d953684cdf8c6a610f769c2ff3/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.053430 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=560653d439844a0cb6943f66e95c2e32, user_id=15cad5d953684cdf8c6a610f769c2ff3, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.056757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.067789 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1271/2540] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:06:58 2022] PUT /identity/v3/projects/560653d439844a0cb6943f66e95c2e32/users/15cad5d953684cdf8c6a610f769c2ff3/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:06:58.078791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.079093 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.079634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.109094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] MFA Rules not processed for user `15cad5d953684cdf8c6a610f769c2ff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:06:58.110315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:58.156270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:06:58.186525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1270/2541] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:06:58 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:06:58.198070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.199799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:58.261288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c85c41-5a8f-4882-8af3-ebabcab663ce admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.264939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.265587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.265875 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.266155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.275948 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.277417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.286838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1272/2542] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:06:58.328855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:06:58.330229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:06:58.342634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06368ce-8d6e-4ee1-862d-4170e992a447 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:06:58.346532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:06:58.347236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:06:58.347524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:06:58.347816 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:06:58.406064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:06:58.407502 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:06:58.416607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1271/2543] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:06:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:00.158947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:00.161054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:00.255175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5138d69-2960-452b-ab64-86b6bf1d1449 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:00.260873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813abb31-fbe8-4898-8be3-255480f11424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:00.261534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abb31-fbe8-4898-8be3-255480f11424 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:00.261825 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abb31-fbe8-4898-8be3-255480f11424 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:00.262127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813abb31-fbe8-4898-8be3-255480f11424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:00.263925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-813abb31-fbe8-4898-8be3-255480f11424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:00.276681 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813abb31-fbe8-4898-8be3-255480f11424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:00.278271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813abb31-fbe8-4898-8be3-255480f11424 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:00.289288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1273/2544] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:01.743964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:01.807635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc07acd8-8db2-481d-8d7c-0f13455d912f service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:01.812239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:01.813080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.813367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.813647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] PATH_INFO: `/v3/users/0a9fe96abdf144a6bfe8b344e61fb294` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.814830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a9fe96abdf144a6bfe8b344e61fb294)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:01.817455 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:01.863860 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a9fe96abdf144a6bfe8b344e61fb294'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:01.870731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a9fe96abdf144a6bfe8b344e61fb294'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:01.883339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a9fe96abdf144a6bfe8b344e61fb294'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:01.883997 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a9fe96abdf144a6bfe8b344e61fb294'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:01.890852 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a9fe96abdf144a6bfe8b344e61fb294'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:01.892986 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:01.898717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1272/2545] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:01 2022] DELETE /identity/v3/users/0a9fe96abdf144a6bfe8b344e61fb294 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:01.903252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:01.903787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:01.903899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:01.921470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:01.922814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:01.989985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1274/2546] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:07:01.999979 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.001715 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:02.068316 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f3f65-5fc1-455f-bb62-782b9d4fc353 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.073095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.073755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.074045 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.074327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.083614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.085692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.095856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1273/2547] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:02.487511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.489009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:02.498982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:02.503180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96eef50-274d-4c1a-b92f-73c18d4296f5 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.509130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.510285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.510574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.510856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] PATH_INFO: `/v3/projects/6143739f715647f4b5b7833c1eeda3d8` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.512089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6143739f715647f4b5b7833c1eeda3d8)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.514084 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.564128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6143739f715647f4b5b7833c1eeda3d8', 'request_id': 'req-5255935b-c75e-49b7-92b8-c8d33f8af42a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.570810 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6143739f715647f4b5b7833c1eeda3d8', 'request_id': 'req-5255935b-c75e-49b7-92b8-c8d33f8af42a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.579005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6143739f715647f4b5b7833c1eeda3d8', 'request_id': 'req-5255935b-c75e-49b7-92b8-c8d33f8af42a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.591112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] The token cache is being invalidate because project 6143739f715647f4b5b7833c1eeda3d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:02.591379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.592077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.593699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1275/2548] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:02 2022] DELETE /identity/v3/projects/6143739f715647f4b5b7833c1eeda3d8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:02.597693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:02.607775 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cd665d-d7f1-4b18-ab27-f90a777f3203 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:02.666921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:02.667960 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:02.668255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:02.668572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] PATH_INFO: `/v3/users/15cad5d953684cdf8c6a610f769c2ff3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:02.669794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15cad5d953684cdf8c6a610f769c2ff3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:02.671724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:02.727810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15cad5d953684cdf8c6a610f769c2ff3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.734962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15cad5d953684cdf8c6a610f769c2ff3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.747602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15cad5d953684cdf8c6a610f769c2ff3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.748323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15cad5d953684cdf8c6a610f769c2ff3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.755619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-41d662c9-86b9-4f91-88e8-3c2acc34e705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15cad5d953684cdf8c6a610f769c2ff3'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:02.762759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1274/2549] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:02 2022] DELETE /identity/v3/users/15cad5d953684cdf8c6a610f769c2ff3 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:03.042631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.044347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:03.078355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5255935b-c75e-49b7-92b8-c8d33f8af42a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.156590 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.157485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.157775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.158059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] PATH_INFO: `/v3/projects/560653d439844a0cb6943f66e95c2e32` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.159302 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=560653d439844a0cb6943f66e95c2e32)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.161315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.212550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560653d439844a0cb6943f66e95c2e32', 'request_id': 'req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:03.218833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560653d439844a0cb6943f66e95c2e32', 'request_id': 'req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:03.227133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560653d439844a0cb6943f66e95c2e32', 'request_id': 'req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:03.238539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] The token cache is being invalidate because project 560653d439844a0cb6943f66e95c2e32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:03.238833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:03.239488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a2b10f57-6dc1-4f8d-9743-3d9277713d6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:03.241067 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1276/2550] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:03 2022] DELETE /identity/v3/projects/560653d439844a0cb6943f66e95c2e32 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:03.245978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c891-b21f-41d5-883b-944c6946a35d None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.246342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c891-b21f-41d5-883b-944c6946a35d None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.246717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f2c891-b21f-41d5-883b-944c6946a35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.270483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-76f2c891-b21f-41d5-883b-944c6946a35d None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:03.271705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-76f2c891-b21f-41d5-883b-944c6946a35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:03.292913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:03.339959 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1275/2551] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:03.347696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fb0c4-5131-4340-8951-c1b7a55f6330 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.347921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fb0c4-5131-4340-8951-c1b7a55f6330 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.348204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8fb0c4-5131-4340-8951-c1b7a55f6330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.368125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6f8fb0c4-5131-4340-8951-c1b7a55f6330 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:03.369374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6f8fb0c4-5131-4340-8951-c1b7a55f6330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:03.377311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1277/2552] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:03.381485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c891-b21f-41d5-883b-944c6946a35d None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.391537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f2c891-b21f-41d5-883b-944c6946a35d None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.396291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.396984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.397275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.398116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.399114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:03.399426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.401064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.416726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1276/2553] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 30 13:07:03.417950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fb0c4-5131-4340-8951-c1b7a55f6330 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.427265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8fb0c4-5131-4340-8951-c1b7a55f6330 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.432278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.433092 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.433374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.433654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.434380 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.436320 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.444880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:03.464404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1278/2554] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:03 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:03.468658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.479393 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96418edf-49ac-49cd-9920-8d7bf2b4acff admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.538322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.539000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.539419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.539704 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.540431 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.542347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.574629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1277/2555] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:03 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:03.578511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.590892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018c02c5-0ee4-4166-bc54-9b6ed2b514f5 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.597566 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.598315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.598598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.598843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.601572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.603197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.606824 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.608614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:03.614869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1279/2556] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:03.619365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.629657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b4a31-96cf-4421-9e0d-e695b27ecd6b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.634851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.635513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.635925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.636367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.637137 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.638968 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.651257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1280/2557] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:03.655554 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.669646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08180e97-3191-4f2c-a4e9-bbe45218a7e7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.671059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089555e0-7acc-4490-b593-5dd49f5919e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.671997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089555e0-7acc-4490-b593-5dd49f5919e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.672283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089555e0-7acc-4490-b593-5dd49f5919e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.672592 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089555e0-7acc-4490-b593-5dd49f5919e1 admin admin] PATH_INFO: `/v3/projects/a82b9b3743244d8f979ec8f2ce7d8b0c/users/17bce73e1087414f943e4ad184ee7e55/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.690378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089555e0-7acc-4490-b593-5dd49f5919e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a82b9b3743244d8f979ec8f2ce7d8b0c, user_id=17bce73e1087414f943e4ad184ee7e55, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.693125 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089555e0-7acc-4490-b593-5dd49f5919e1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.709659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1281/2558] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:03 2022] PUT /identity/v3/projects/a82b9b3743244d8f979ec8f2ce7d8b0c/users/17bce73e1087414f943e4ad184ee7e55/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:03.710182 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435b0407-67fd-49f8-8f18-463e09f0952a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.763031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:03.774419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428ac8-404b-4eda-a206-80b491f6d280 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.774692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428ac8-404b-4eda-a206-80b491f6d280 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.775024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50428ac8-404b-4eda-a206-80b491f6d280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.805043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.805919 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.806205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.806419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-50428ac8-404b-4eda-a206-80b491f6d280 None None] MFA Rules not processed for user `17bce73e1087414f943e4ad184ee7e55`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:03.806528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.807820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-50428ac8-404b-4eda-a206-80b491f6d280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:03.809025 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:03.824222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.826186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:03.840982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1278/2559] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:07:03.891931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1282/2560] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:03.896714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:03.972536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7499829e-b26d-457a-b857-4aa554591964 service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:03.977296 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:03.977968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:03.978419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:03.978842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:03.979547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:03.981529 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.011272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1279/2561] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:03 2022] POST /identity/v3/projects => generated 381 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:04.015435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428ac8-404b-4eda-a206-80b491f6d280 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.029179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50428ac8-404b-4eda-a206-80b491f6d280 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.096265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.096988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.097274 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.097561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.098281 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.100261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.132899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1283/2562] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:04 2022] POST /identity/v3/users => generated 297 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:04.137605 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.151922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce78f33b-6273-434b-a0d5-3efb39e5fd99 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.156927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.157592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.157874 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.158161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.158884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.160496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.179854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1280/2563] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:04.184570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.195180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2660112-3514-467c-adbb-9dfd22dca4df admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.199931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.201124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.201261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.201586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] PATH_INFO: `/v3/projects/755fa5d81244446ab61fefae1aac024a/users/a4ddddb513ee46b28ba8ba7945baede1/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.221586 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=755fa5d81244446ab61fefae1aac024a, user_id=a4ddddb513ee46b28ba8ba7945baede1, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.224545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.235571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:04.245379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1284/2564] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:04 2022] PUT /identity/v3/projects/755fa5d81244446ab61fefae1aac024a/users/a4ddddb513ee46b28ba8ba7945baede1/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:04.249352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.260639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8c342a-8411-4ebe-bbf5-0c4de92b92d4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.325888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25d763-9b01-4141-8b98-60c2ed462a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.326562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25d763-9b01-4141-8b98-60c2ed462a02 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.326847 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25d763-9b01-4141-8b98-60c2ed462a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.327178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25d763-9b01-4141-8b98-60c2ed462a02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.327908 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25d763-9b01-4141-8b98-60c2ed462a02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.329561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25d763-9b01-4141-8b98-60c2ed462a02 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.343617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1281/2565] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:04 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:04.345152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.356291 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01862ee9-00df-4d07-ba19-ad340f8501b8 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.361533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.362370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.362813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.363099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] PATH_INFO: `/v3/projects/755fa5d81244446ab61fefae1aac024a/users/a4ddddb513ee46b28ba8ba7945baede1/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.365423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=755fa5d81244446ab61fefae1aac024a, user_id=a4ddddb513ee46b28ba8ba7945baede1, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.368202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.379673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1285/2566] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:04 2022] PUT /identity/v3/projects/755fa5d81244446ab61fefae1aac024a/users/a4ddddb513ee46b28ba8ba7945baede1/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:04.391457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9267b-6d85-40d9-bcf5-8ed0340a8af3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.391751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9267b-6d85-40d9-bcf5-8ed0340a8af3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.392034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9267b-6d85-40d9-bcf5-8ed0340a8af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.423054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-edb9267b-6d85-40d9-bcf5-8ed0340a8af3 None None] MFA Rules not processed for user `a4ddddb513ee46b28ba8ba7945baede1`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:04.424517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-edb9267b-6d85-40d9-bcf5-8ed0340a8af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:04.447131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:04.506755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1282/2567] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:04 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:04.518355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:04.520194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:04.582088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae2ec3d-9d14-49cd-b1bc-5a717470bffa admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:04.585874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787a1c28-62d9-4c6e-967f-b2fb433a8103 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:04.586529 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a1c28-62d9-4c6e-967f-b2fb433a8103 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:04.586819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a1c28-62d9-4c6e-967f-b2fb433a8103 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:04.587104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787a1c28-62d9-4c6e-967f-b2fb433a8103 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:04.596227 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a1c28-62d9-4c6e-967f-b2fb433a8103 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:04.597713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787a1c28-62d9-4c6e-967f-b2fb433a8103 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:04.608316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1286/2568] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:04 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:04.987375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9267b-6d85-40d9-bcf5-8ed0340a8af3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.049100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9267b-6d85-40d9-bcf5-8ed0340a8af3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.053677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.055037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.055353 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.055636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] PATH_INFO: `/v3/users/17bce73e1087414f943e4ad184ee7e55` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.057620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17bce73e1087414f943e4ad184ee7e55)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.059822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.106891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17bce73e1087414f943e4ad184ee7e55'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.114326 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17bce73e1087414f943e4ad184ee7e55'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.126060 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17bce73e1087414f943e4ad184ee7e55'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.126695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17bce73e1087414f943e4ad184ee7e55'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.133947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17bce73e1087414f943e4ad184ee7e55'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.139786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1283/2569] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:04 2022] DELETE /identity/v3/users/17bce73e1087414f943e4ad184ee7e55 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:05.144404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.144871 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.144999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.163722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:05.165011 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:05.227565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1287/2570] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:05.234547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.236405 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:05.283016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:05.301019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fffb6b1-4e10-4fa6-9da0-1de0a463512a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.305669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.306391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.306707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.306998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.319020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.321334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.331815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1284/2571] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:05.610414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.612667 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:05.626502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557bb371-3079-4f9d-ad3b-d9b4a8d2771f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.631234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.632494 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.632807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.633075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] PATH_INFO: `/v3/projects/a82b9b3743244d8f979ec8f2ce7d8b0c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.634372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a82b9b3743244d8f979ec8f2ce7d8b0c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.636295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.685440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a82b9b3743244d8f979ec8f2ce7d8b0c', 'request_id': 'req-3dbe1e04-2d04-40af-999e-64184c7e19e6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.692996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a82b9b3743244d8f979ec8f2ce7d8b0c', 'request_id': 'req-3dbe1e04-2d04-40af-999e-64184c7e19e6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.701425 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a82b9b3743244d8f979ec8f2ce7d8b0c', 'request_id': 'req-3dbe1e04-2d04-40af-999e-64184c7e19e6'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.712974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] The token cache is being invalidate because project a82b9b3743244d8f979ec8f2ce7d8b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:05.713416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.714059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.715619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1288/2572] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:05 2022] DELETE /identity/v3/projects/a82b9b3743244d8f979ec8f2ce7d8b0c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:05.719570 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:05.729363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88002c7-b3f6-44d9-aa87-2125cd9e2070 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:05.786206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:05.787064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:05.787346 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:05.787621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] PATH_INFO: `/v3/users/a4ddddb513ee46b28ba8ba7945baede1` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:05.789421 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ddddb513ee46b28ba8ba7945baede1)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:05.791325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:05.837030 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ddddb513ee46b28ba8ba7945baede1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.844266 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ddddb513ee46b28ba8ba7945baede1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.856240 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ddddb513ee46b28ba8ba7945baede1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.856907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ddddb513ee46b28ba8ba7945baede1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.864126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-bfdcf826-c56d-46f6-877f-49a95d412aa2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ddddb513ee46b28ba8ba7945baede1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:05.870118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1285/2573] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:05 2022] DELETE /identity/v3/users/a4ddddb513ee46b28ba8ba7945baede1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:06.135837 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.137315 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:06.153505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe1e04-2d04-40af-999e-64184c7e19e6 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.161775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.216164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.217498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.217932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.218359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] PATH_INFO: `/v3/projects/755fa5d81244446ab61fefae1aac024a` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.220113 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] RBAC: Authorizing `identity:delete_project(project_id=755fa5d81244446ab61fefae1aac024a)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.223259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.293883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '755fa5d81244446ab61fefae1aac024a', 'request_id': 'req-da142f40-809d-4d16-a7bd-44679ddd7098'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:06.300024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '755fa5d81244446ab61fefae1aac024a', 'request_id': 'req-da142f40-809d-4d16-a7bd-44679ddd7098'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:06.308069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '755fa5d81244446ab61fefae1aac024a', 'request_id': 'req-da142f40-809d-4d16-a7bd-44679ddd7098'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:06.320347 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] The token cache is being invalidate because project 755fa5d81244446ab61fefae1aac024a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:06.320730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:06.321363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-da142f40-809d-4d16-a7bd-44679ddd7098 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:06.322899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1289/2574] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:06 2022] DELETE /identity/v3/projects/755fa5d81244446ab61fefae1aac024a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:06.327744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280234d3-362f-446f-97a2-6ff4ef5e251f None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.328210 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280234d3-362f-446f-97a2-6ff4ef5e251f None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.328336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280234d3-362f-446f-97a2-6ff4ef5e251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.345766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-280234d3-362f-446f-97a2-6ff4ef5e251f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:06.346988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-280234d3-362f-446f-97a2-6ff4ef5e251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:06.398987 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.409587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1286/2575] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:06.418626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742907aa-5957-4996-bd0a-2afe4353f221 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.418980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742907aa-5957-4996-bd0a-2afe4353f221 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.419489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742907aa-5957-4996-bd0a-2afe4353f221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.439537 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-742907aa-5957-4996-bd0a-2afe4353f221 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:06.440808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-742907aa-5957-4996-bd0a-2afe4353f221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:06.449596 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1290/2576] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:06.453740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280234d3-362f-446f-97a2-6ff4ef5e251f None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.463982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280234d3-362f-446f-97a2-6ff4ef5e251f None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.468716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.469368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.469678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.469954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.470697 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:06.471005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.472658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.484801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1287/2577] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:06.488686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742907aa-5957-4996-bd0a-2afe4353f221 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.498275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742907aa-5957-4996-bd0a-2afe4353f221 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.502958 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.503602 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.503890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.504173 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.504907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.506835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.533629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1291/2578] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:06.536982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.547190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc5055e-876e-4c72-870d-548bbc10d55e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.605566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.606234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.606522 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.606801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.607477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.609420 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.628672 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1288/2579] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:06.632749 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.643821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421a40d3-5599-42cd-acb1-3e58c1c1c8de admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.649624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.650052 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.650341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.650662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.651385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.653040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.663424 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1292/2580] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:06.667447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.677914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef90614-da3e-4332-b13e-9cbfbde593ab admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.682669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92b4978-2910-43e2-ad15-24c72324f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.683327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b4978-2910-43e2-ad15-24c72324f493 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.683620 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b4978-2910-43e2-ad15-24c72324f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.683905 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92b4978-2910-43e2-ad15-24c72324f493 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.684676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b4978-2910-43e2-ad15-24c72324f493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.686286 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92b4978-2910-43e2-ad15-24c72324f493 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.697013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1289/2581] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:06.700849 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.710777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b996d924-bef8-4a12-b1f9-010061be44ff admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.716526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.717416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.717705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.717988 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] PATH_INFO: `/v3/projects/b9f1da861a044618a274c5b8f8113c89/users/8b87b41c6e4c480b8d312ab144652c14/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.732790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9f1da861a044618a274c5b8f8113c89, user_id=8b87b41c6e4c480b8d312ab144652c14, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.735459 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.748674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1293/2582] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:06 2022] PUT /identity/v3/projects/b9f1da861a044618a274c5b8f8113c89/users/8b87b41c6e4c480b8d312ab144652c14/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:06.759423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc4103-26f5-4e6b-8484-91225b01e279 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.759721 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc4103-26f5-4e6b-8484-91225b01e279 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.760008 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfc4103-26f5-4e6b-8484-91225b01e279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.787671 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3dfc4103-26f5-4e6b-8484-91225b01e279 None None] MFA Rules not processed for user `8b87b41c6e4c480b8d312ab144652c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:06.788932 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3dfc4103-26f5-4e6b-8484-91225b01e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:06.852526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1290/2583] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:06.857048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.897714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:06.921587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d45ed3-94b1-4c8d-9944-0ddfc5c8c89b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:06.926429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:06.927091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:06.927379 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:06.927661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:06.928364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:06.931293 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:06.957401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1294/2584] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:06.961323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc4103-26f5-4e6b-8484-91225b01e279 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:06.972056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfc4103-26f5-4e6b-8484-91225b01e279 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.021882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.030023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.030883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.031184 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.031476 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.032178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.034152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.054078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1291/2585] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:06 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:07.058677 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.069048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c706cf6c-9bf3-4a9c-8d49-190070e8b198 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.075021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.075700 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.075994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.076289 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.077043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.078639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.089186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1295/2586] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:07.093315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.103287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf23a261-e31f-4594-a01b-10b7042cd421 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.107920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.108821 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.109110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.109394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] PATH_INFO: `/v3/projects/fe853d00f3724082b6cf309521131226/users/330c9a59d1ce45dda8032f582f2dad65/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.124613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe853d00f3724082b6cf309521131226, user_id=330c9a59d1ce45dda8032f582f2dad65, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.127270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.140678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1292/2587] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:07 2022] PUT /identity/v3/projects/fe853d00f3724082b6cf309521131226/users/330c9a59d1ce45dda8032f582f2dad65/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:07.144734 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.155003 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98a94d8-5bf9-423e-b059-92c346680420 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.210798 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef200d8f-b4e5-43da-b44b-fc6b21f17e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.211562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200d8f-b4e5-43da-b44b-fc6b21f17e0b admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.211900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200d8f-b4e5-43da-b44b-fc6b21f17e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.212186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef200d8f-b4e5-43da-b44b-fc6b21f17e0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.212952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200d8f-b4e5-43da-b44b-fc6b21f17e0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.214571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef200d8f-b4e5-43da-b44b-fc6b21f17e0b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.224179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1296/2588] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:07.228443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.238875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785fc6b-b867-40da-b2a9-bdb05898757a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.244077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.244986 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.245272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.245549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] PATH_INFO: `/v3/projects/fe853d00f3724082b6cf309521131226/users/330c9a59d1ce45dda8032f582f2dad65/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.247525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe853d00f3724082b6cf309521131226, user_id=330c9a59d1ce45dda8032f582f2dad65, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.250248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.260702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1293/2589] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:07 2022] PUT /identity/v3/projects/fe853d00f3724082b6cf309521131226/users/330c9a59d1ce45dda8032f582f2dad65/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:07.270506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74476c9-86a8-4fdb-969d-0e60f1d989e0 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.270809 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74476c9-86a8-4fdb-969d-0e60f1d989e0 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.271099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74476c9-86a8-4fdb-969d-0e60f1d989e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.305884 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b74476c9-86a8-4fdb-969d-0e60f1d989e0 None None] MFA Rules not processed for user `330c9a59d1ce45dda8032f582f2dad65`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:07.307296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b74476c9-86a8-4fdb-969d-0e60f1d989e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:07.377776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1297/2590] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:07 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:07.389372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.391214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:07.449856 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5668557-c170-4f3f-85f8-00958bb73641 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.453575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.454221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.454510 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.454793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.463777 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.465174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.474475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1294/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:07.543552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74476c9-86a8-4fdb-969d-0e60f1d989e0 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.552986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74476c9-86a8-4fdb-969d-0e60f1d989e0 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.557283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a20c90-6030-4413-8c4e-41c4b046fd63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.557921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a20c90-6030-4413-8c4e-41c4b046fd63 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.558208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a20c90-6030-4413-8c4e-41c4b046fd63 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.558488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a20c90-6030-4413-8c4e-41c4b046fd63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.588359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:07.623959 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a20c90-6030-4413-8c4e-41c4b046fd63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.625464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a20c90-6030-4413-8c4e-41c4b046fd63 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:07.634485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1298/2592] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:07.890418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:07.953900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690406d8-741d-475a-b3f0-1de3c8223374 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:07.958496 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:07.959364 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:07.959656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:07.959940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] PATH_INFO: `/v3/users/8b87b41c6e4c480b8d312ab144652c14` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:07.961234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b87b41c6e4c480b8d312ab144652c14)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:07.963450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.007485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b87b41c6e4c480b8d312ab144652c14'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.011778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:08.015658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b87b41c6e4c480b8d312ab144652c14'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.029018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b87b41c6e4c480b8d312ab144652c14'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.029652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b87b41c6e4c480b8d312ab144652c14'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.036366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b87b41c6e4c480b8d312ab144652c14'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.042638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1295/2593] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:07 2022] DELETE /identity/v3/users/8b87b41c6e4c480b8d312ab144652c14 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:08.047150 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.047454 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.047771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.066814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:08.068034 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:08.127974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1299/2594] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:07:08.137561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.138964 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:08.197386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832d401b-f83e-4e22-8fc4-d14d3334d827 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.201056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.201703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.201990 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.202272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.211134 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.212597 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.221909 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1296/2595] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:08.495399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.496960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:08.511583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6ac84-f358-447c-8638-5b34be41b97f None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.517496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.518556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.518966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.519350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] PATH_INFO: `/v3/projects/b9f1da861a044618a274c5b8f8113c89` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.520856 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9f1da861a044618a274c5b8f8113c89)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.523697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.572371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9f1da861a044618a274c5b8f8113c89', 'request_id': 'req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.578344 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9f1da861a044618a274c5b8f8113c89', 'request_id': 'req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.585404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9f1da861a044618a274c5b8f8113c89', 'request_id': 'req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.596589 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] The token cache is being invalidate because project b9f1da861a044618a274c5b8f8113c89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:08.596880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.597501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.599023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1300/2596] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:08 2022] DELETE /identity/v3/projects/b9f1da861a044618a274c5b8f8113c89 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:08.602938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:08.613913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef42cf36-1f33-4297-9aab-3d6728accb5f service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:08.669244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:08.670268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:08.670551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:08.670830 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] PATH_INFO: `/v3/users/330c9a59d1ce45dda8032f582f2dad65` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:08.672056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] RBAC: Authorizing `identity:delete_user(user_id=330c9a59d1ce45dda8032f582f2dad65)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:08.674013 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:08.719014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330c9a59d1ce45dda8032f582f2dad65'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.726031 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330c9a59d1ce45dda8032f582f2dad65'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.738345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330c9a59d1ce45dda8032f582f2dad65'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.739041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330c9a59d1ce45dda8032f582f2dad65'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.740982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:08.747248 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330c9a59d1ce45dda8032f582f2dad65'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:08.754272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1297/2597] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:08 2022] DELETE /identity/v3/users/330c9a59d1ce45dda8032f582f2dad65 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:09.033632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:09.035191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:09.052262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90fbbe5-e356-49cb-9059-fe5dc8dc6630 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:09.108738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:09.116840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:09.117848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:09.118204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:09.118744 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] PATH_INFO: `/v3/projects/fe853d00f3724082b6cf309521131226` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:09.120193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe853d00f3724082b6cf309521131226)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:09.122342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:09.168711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe853d00f3724082b6cf309521131226', 'request_id': 'req-2fc72d0e-9e74-4170-82aa-d72368379e5e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:09.174599 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe853d00f3724082b6cf309521131226', 'request_id': 'req-2fc72d0e-9e74-4170-82aa-d72368379e5e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:09.181199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe853d00f3724082b6cf309521131226', 'request_id': 'req-2fc72d0e-9e74-4170-82aa-d72368379e5e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:09.191492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] The token cache is being invalidate because project fe853d00f3724082b6cf309521131226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:09.191780 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:09.192417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:09.193938 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1301/2598] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:09 2022] DELETE /identity/v3/projects/fe853d00f3724082b6cf309521131226 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:18.752167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:19.188635 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=26,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:25.250074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:25.251504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:25.308264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6751fbc1-9cd7-4086-80c1-f42cd2390997 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:25.366413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:25.367065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:25.367356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:25.367639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:25.370042 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:25.437976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:25.439328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:25.450225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1298/2599] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:28.529085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.530625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:28.584028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.585945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:28.600535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc335b5f-c7cb-4899-9ac2-338b64a64d8f service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.606716 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.607592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.607882 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.608166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] PATH_INFO: `/v3/users/2a859567189a41e2b7edd6a2e17f87c2` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.609401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a859567189a41e2b7edd6a2e17f87c2)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.611329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:28.623964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc72d0e-9e74-4170-82aa-d72368379e5e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.629133 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.629792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.630085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.630374 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.632163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:28.645416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.646998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:28.659035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1302/2600] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:28.668429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a859567189a41e2b7edd6a2e17f87c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:28.675571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a859567189a41e2b7edd6a2e17f87c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:28.681943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:28.691489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a859567189a41e2b7edd6a2e17f87c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:28.692768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a859567189a41e2b7edd6a2e17f87c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:28.703935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-8305cf66-ef3c-40cf-bee8-d761e72627e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a859567189a41e2b7edd6a2e17f87c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:28.710055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1299/2601] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:28 2022] DELETE /identity/v3/users/2a859567189a41e2b7edd6a2e17f87c2 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:28.885916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:28.899511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910df0-f9de-45ba-bfbc-3fb9e281ebc3 service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:28.956269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:28.957151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:28.957433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:28.957708 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] PATH_INFO: `/v3/projects/1e37dc29ad07404cb1b2e5c68327ede2` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:28.958877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e37dc29ad07404cb1b2e5c68327ede2)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:28.960852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.005288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e37dc29ad07404cb1b2e5c68327ede2', 'request_id': 'req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:29.011181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e37dc29ad07404cb1b2e5c68327ede2', 'request_id': 'req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:29.018407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e37dc29ad07404cb1b2e5c68327ede2', 'request_id': 'req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:29.029149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] The token cache is being invalidate because project 1e37dc29ad07404cb1b2e5c68327ede2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:29.029449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:29.030082 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-4b9df4bd-bf0b-40d1-bd2a-25405faa3e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:29.031600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1303/2602] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:28 2022] DELETE /identity/v3/projects/1e37dc29ad07404cb1b2e5c68327ede2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:29.037401 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dde71-df22-4034-befa-dda10cf37499 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.037701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dde71-df22-4034-befa-dda10cf37499 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.037989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12dde71-df22-4034-befa-dda10cf37499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.056925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-a12dde71-df22-4034-befa-dda10cf37499 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:29.058135 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-a12dde71-df22-4034-befa-dda10cf37499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:29.116823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1300/2603] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:29.125104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621720e5-f026-4829-b9c7-a8921a277bef None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.125398 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621720e5-f026-4829-b9c7-a8921a277bef None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.125682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621720e5-f026-4829-b9c7-a8921a277bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.143456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-621720e5-f026-4829-b9c7-a8921a277bef None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:29.144678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-621720e5-f026-4829-b9c7-a8921a277bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:29.152675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1304/2604] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:29.156962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dde71-df22-4034-befa-dda10cf37499 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.167448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12dde71-df22-4034-befa-dda10cf37499 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.172096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.172790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.173080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.173367 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.174087 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:29.174429 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.176011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.188516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1301/2605] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:29.192612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621720e5-f026-4829-b9c7-a8921a277bef None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.201786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621720e5-f026-4829-b9c7-a8921a277bef None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.206458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.207100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.207382 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.207658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.208368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.210266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.220198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:29.238442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1305/2606] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:29 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:29.242463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.253203 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefeea6d-fe1d-4025-8f02-c61b73ad7d45 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.318168 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.318841 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.319129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.319402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.320137 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.322117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.342070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1302/2607] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:29 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:29.346122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.357102 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e6788-aa58-4d2f-b1ce-26a3edf023ba admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.361632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.362285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.362571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.362848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.363575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.365207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.375154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1306/2608] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:29.378922 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.389542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ba21af-1939-4d7d-949a-e80de17fe5ec admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.394187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2044a-8fba-45c6-b4a4-a36cc4b7451d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.394843 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2044a-8fba-45c6-b4a4-a36cc4b7451d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.395131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2044a-8fba-45c6-b4a4-a36cc4b7451d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.395413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2044a-8fba-45c6-b4a4-a36cc4b7451d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.396140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2044a-8fba-45c6-b4a4-a36cc4b7451d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.397758 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2044a-8fba-45c6-b4a4-a36cc4b7451d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.408916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1303/2609] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:29.413073 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.424777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb748495-f2e3-4689-aa21-712ab0acf4c1 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.429906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.430819 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.431104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.431504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] PATH_INFO: `/v3/projects/fc00793bd85c4d26ba5e4457377fb4c5/users/f5e60e3ee2224b04981549009086eedd/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.445842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc00793bd85c4d26ba5e4457377fb4c5, user_id=f5e60e3ee2224b04981549009086eedd, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.448752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.461095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1307/2610] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:29 2022] PUT /identity/v3/projects/fc00793bd85c4d26ba5e4457377fb4c5/users/f5e60e3ee2224b04981549009086eedd/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:29.472338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1aaae-cf4c-4db0-af2a-60945a23f95a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.472665 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1aaae-cf4c-4db0-af2a-60945a23f95a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.472949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c1aaae-cf4c-4db0-af2a-60945a23f95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.501366 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-29c1aaae-cf4c-4db0-af2a-60945a23f95a None None] MFA Rules not processed for user `f5e60e3ee2224b04981549009086eedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:29.502587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-29c1aaae-cf4c-4db0-af2a-60945a23f95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:29.535451 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:29.569351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1304/2611] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:29.580360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:29.582208 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:29.660307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffae1d-22d0-4482-9f13-166a1527c0f2 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:29.667565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c09987a-4a35-4c14-9b1e-cd6f8b8b9699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:29.668234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09987a-4a35-4c14-9b1e-cd6f8b8b9699 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:29.668562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09987a-4a35-4c14-9b1e-cd6f8b8b9699 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:29.668841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c09987a-4a35-4c14-9b1e-cd6f8b8b9699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:29.677783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09987a-4a35-4c14-9b1e-cd6f8b8b9699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:29.679391 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c09987a-4a35-4c14-9b1e-cd6f8b8b9699 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:29.688510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1308/2612] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:34.844283 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1aaae-cf4c-4db0-af2a-60945a23f95a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:34.904712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c1aaae-cf4c-4db0-af2a-60945a23f95a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:34.909265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:34.910129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:34.910417 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:34.910702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] PATH_INFO: `/v3/users/f5e60e3ee2224b04981549009086eedd` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:34.911891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e60e3ee2224b04981549009086eedd)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:34.913842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:34.960351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e60e3ee2224b04981549009086eedd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:34.968170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e60e3ee2224b04981549009086eedd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:34.979988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e60e3ee2224b04981549009086eedd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:34.980650 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e60e3ee2224b04981549009086eedd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:34.987812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e60e3ee2224b04981549009086eedd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:34.993605 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1305/2613] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:34 2022] DELETE /identity/v3/users/f5e60e3ee2224b04981549009086eedd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:34.998338 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:34.998847 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:34.998947 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.017339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:35.018545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:35.075748 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1309/2614] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:35.085419 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.086872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:35.144427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984dc982-d64b-4ea3-8746-a47cf3c6977c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.148049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba67fad7-4c0a-4671-9505-fa3b481abcca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.148974 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fad7-4c0a-4671-9505-fa3b481abcca service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.149265 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fad7-4c0a-4671-9505-fa3b481abcca service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.149549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba67fad7-4c0a-4671-9505-fa3b481abcca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.156454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:35.158778 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67fad7-4c0a-4671-9505-fa3b481abcca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.160779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba67fad7-4c0a-4671-9505-fa3b481abcca service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.172205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1306/2615] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:07:35.438885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.440653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:35.454031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aaf554-09b8-4e89-96e7-f175a1ff0fbc None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.458674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.459564 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.459836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.460117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] PATH_INFO: `/v3/projects/fc00793bd85c4d26ba5e4457377fb4c5` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.461378 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc00793bd85c4d26ba5e4457377fb4c5)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.463350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.501865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:35.512583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc00793bd85c4d26ba5e4457377fb4c5', 'request_id': 'req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:35.518561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc00793bd85c4d26ba5e4457377fb4c5', 'request_id': 'req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:35.526048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc00793bd85c4d26ba5e4457377fb4c5', 'request_id': 'req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:35.536733 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] The token cache is being invalidate because project fc00793bd85c4d26ba5e4457377fb4c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:35.537027 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:35.537659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-49bc3ae7-1e95-404a-a5c1-3f939fadf05f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:35.539180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1310/2616] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:35 2022] DELETE /identity/v3/projects/fc00793bd85c4d26ba5e4457377fb4c5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:35.544770 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a6a0-2524-4c22-a9f7-b2690e25e3b3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.545066 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a6a0-2524-4c22-a9f7-b2690e25e3b3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.545349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d086a6a0-2524-4c22-a9f7-b2690e25e3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.562687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-d086a6a0-2524-4c22-a9f7-b2690e25e3b3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:35.563880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d086a6a0-2524-4c22-a9f7-b2690e25e3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:35.624272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1307/2617] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:35.632065 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeee48-6def-4099-a04e-9bfbec7eb8ca None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.632367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeee48-6def-4099-a04e-9bfbec7eb8ca None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.632691 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adeee48-6def-4099-a04e-9bfbec7eb8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.652088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6adeee48-6def-4099-a04e-9bfbec7eb8ca None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:35.653790 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6adeee48-6def-4099-a04e-9bfbec7eb8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:35.664690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1311/2618] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:35.670225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a6a0-2524-4c22-a9f7-b2690e25e3b3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.680234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d086a6a0-2524-4c22-a9f7-b2690e25e3b3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.687111 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.688174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.688785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.689229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.690301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:35.690831 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.693191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.707263 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1308/2619] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:35.711689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeee48-6def-4099-a04e-9bfbec7eb8ca None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.720945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adeee48-6def-4099-a04e-9bfbec7eb8ca None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.725579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.726221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.726506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.726782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.727467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.729395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.755472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1312/2620] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:35 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:35.759670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.769799 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8290865f-279f-4e84-960c-4cd3d8d88e72 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.828299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.829001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.829315 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.829699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.830282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.832222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.851875 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1309/2621] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:35 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:35.857169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.867394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fb5e8a-102a-43bf-beda-c2f923b3fc94 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.873163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.873822 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.874118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.874393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.875116 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.876782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.887231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1313/2622] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:35.891524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.901700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd324d4-eef9-4392-a302-85dfc23a64eb admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.906350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6bb1ff-80a2-4b02-bdf3-029f6a905b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.907000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb1ff-80a2-4b02-bdf3-029f6a905b7d admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.907291 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb1ff-80a2-4b02-bdf3-029f6a905b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.907574 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6bb1ff-80a2-4b02-bdf3-029f6a905b7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.908298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bb1ff-80a2-4b02-bdf3-029f6a905b7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.909927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6bb1ff-80a2-4b02-bdf3-029f6a905b7d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.920297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1310/2623] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:35.924175 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:35.933892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e128aed-5936-4616-a435-4dd1a60d2279 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:35.939087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:35.939953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.940240 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.940553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] PATH_INFO: `/v3/projects/32ce6df199bf432f8d9312826bfd466a/users/7d7957a602c04b40856c484da7d09b45/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:35.955219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ce6df199bf432f8d9312826bfd466a, user_id=7d7957a602c04b40856c484da7d09b45, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:35.957921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:35.970983 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1314/2624] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:35 2022] PUT /identity/v3/projects/32ce6df199bf432f8d9312826bfd466a/users/7d7957a602c04b40856c484da7d09b45/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:35.981828 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ee502-1047-4cd4-a99e-4728d12b8c9a None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:35.982132 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ee502-1047-4cd4-a99e-4728d12b8c9a None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:35.982416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ee502-1047-4cd4-a99e-4728d12b8c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:36.009564 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-bb4ee502-1047-4cd4-a99e-4728d12b8c9a None None] MFA Rules not processed for user `7d7957a602c04b40856c484da7d09b45`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:36.010779 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bb4ee502-1047-4cd4-a99e-4728d12b8c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:36.060061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:36.078243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1311/2625] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:35 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:36.092163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:36.093922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:36.170506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b1d01-16d9-4657-8db1-465a2cf2907c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:36.176031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36081659-e782-4f67-9109-288a679c3504 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:36.176722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081659-e782-4f67-9109-288a679c3504 service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:36.177013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081659-e782-4f67-9109-288a679c3504 service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:36.177301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36081659-e782-4f67-9109-288a679c3504 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:36.185449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36081659-e782-4f67-9109-288a679c3504 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:36.187043 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36081659-e782-4f67-9109-288a679c3504 service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:36.195724 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1315/2626] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:36.412818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ee502-1047-4cd4-a99e-4728d12b8c9a None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:36.475857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ee502-1047-4cd4-a99e-4728d12b8c9a None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:36.480328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:36.482108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:36.482403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:36.482687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] PATH_INFO: `/v3/users/7d7957a602c04b40856c484da7d09b45` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:36.483870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d7957a602c04b40856c484da7d09b45)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:36.485795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:36.532586 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d7957a602c04b40856c484da7d09b45'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:36.539512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d7957a602c04b40856c484da7d09b45'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:36.552334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d7957a602c04b40856c484da7d09b45'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:36.553005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d7957a602c04b40856c484da7d09b45'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:36.560399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d7957a602c04b40856c484da7d09b45'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:36.566391 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1312/2627] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:36 2022] DELETE /identity/v3/users/7d7957a602c04b40856c484da7d09b45 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:36.571058 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:36.571355 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:36.571639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:36.589243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:36.590465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:36.632360 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:36.651301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1316/2628] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:36.660933 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:36.662335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:36.724794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f31f5-ec44-4b89-a360-5769f7a9fb35 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:36.728445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b122beb-75c7-4478-99d5-4e552b6f8aa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:36.729091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122beb-75c7-4478-99d5-4e552b6f8aa5 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:36.729375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122beb-75c7-4478-99d5-4e552b6f8aa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:36.729655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b122beb-75c7-4478-99d5-4e552b6f8aa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:36.739205 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b122beb-75c7-4478-99d5-4e552b6f8aa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:36.740657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b122beb-75c7-4478-99d5-4e552b6f8aa5 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:36.751076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1313/2629] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:37.021075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.022526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:37.045422 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c464001-13c5-45bc-8462-a402146dc61b None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.050040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.050953 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.051244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.051528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] PATH_INFO: `/v3/projects/32ce6df199bf432f8d9312826bfd466a` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.052765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ce6df199bf432f8d9312826bfd466a)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.054713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.112226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ce6df199bf432f8d9312826bfd466a', 'request_id': 'req-59fdd91b-930d-48b8-9a82-87b564f1f86e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:37.118519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ce6df199bf432f8d9312826bfd466a', 'request_id': 'req-59fdd91b-930d-48b8-9a82-87b564f1f86e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:37.126213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ce6df199bf432f8d9312826bfd466a', 'request_id': 'req-59fdd91b-930d-48b8-9a82-87b564f1f86e'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:37.136440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] The token cache is being invalidate because project 32ce6df199bf432f8d9312826bfd466a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:37.136728 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:37.137891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-59fdd91b-930d-48b8-9a82-87b564f1f86e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:37.139598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1317/2630] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:37 2022] DELETE /identity/v3/projects/32ce6df199bf432f8d9312826bfd466a => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:37.144558 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b456-ad35-4ed9-8be4-291c8a32e439 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.145043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b456-ad35-4ed9-8be4-291c8a32e439 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.145143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9939b456-ad35-4ed9-8be4-291c8a32e439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.163501 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-9939b456-ad35-4ed9-8be4-291c8a32e439 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:37.164742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9939b456-ad35-4ed9-8be4-291c8a32e439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:37.173389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:37.233688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1314/2631] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:37.241511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b413-c692-49a9-bde6-1b3e1b644f27 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.241806 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b413-c692-49a9-bde6-1b3e1b644f27 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.242089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24b413-c692-49a9-bde6-1b3e1b644f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.260343 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9e24b413-c692-49a9-bde6-1b3e1b644f27 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:37.261575 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9e24b413-c692-49a9-bde6-1b3e1b644f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:37.270278 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1318/2632] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:37.274550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b456-ad35-4ed9-8be4-291c8a32e439 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.284849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9939b456-ad35-4ed9-8be4-291c8a32e439 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.289373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.290049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.290337 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.290627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.291372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:37.291691 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.293323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.304846 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1315/2633] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:37.309368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b413-c692-49a9-bde6-1b3e1b644f27 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.318975 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24b413-c692-49a9-bde6-1b3e1b644f27 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.323685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.324357 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.325181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.325528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.326402 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.328345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.354261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1319/2634] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:37.358621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.368461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93433dd8-4b0c-450a-9f2a-4532b65b5c80 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.425844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.426709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.426999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.427277 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.427976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.429915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.449221 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1316/2635] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:37.454200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.464479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f9d4d-fce3-4acf-acb1-62b9ad030817 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.469771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.470423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.470711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.470993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.471717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.473337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.483906 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1320/2636] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:37.487525 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.497958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d34c6-f60e-46a6-97b0-3834e8e23783 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.502750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1719f9d2-35a2-49ee-a8f3-8744cefa9f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.503408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719f9d2-35a2-49ee-a8f3-8744cefa9f35 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.503701 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719f9d2-35a2-49ee-a8f3-8744cefa9f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.503983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1719f9d2-35a2-49ee-a8f3-8744cefa9f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.504757 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719f9d2-35a2-49ee-a8f3-8744cefa9f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.506342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1719f9d2-35a2-49ee-a8f3-8744cefa9f35 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.517050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1317/2637] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:37.521072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.531510 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8af6c9-07fb-4d9f-a5e5-77bc87d10f43 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.536047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.536957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.537242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.537519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] PATH_INFO: `/v3/projects/59ca3b77825e4331aefe410767310639/users/c4757259aa3441e384ccfc57543ef01f/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.553218 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ca3b77825e4331aefe410767310639, user_id=c4757259aa3441e384ccfc57543ef01f, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.555942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.569395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1321/2638] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:37 2022] PUT /identity/v3/projects/59ca3b77825e4331aefe410767310639/users/c4757259aa3441e384ccfc57543ef01f/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:37.579771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dfa05-da23-495d-a29c-4ade3c195578 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.580064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dfa05-da23-495d-a29c-4ade3c195578 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.580345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370dfa05-da23-495d-a29c-4ade3c195578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.607464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-370dfa05-da23-495d-a29c-4ade3c195578 None None] MFA Rules not processed for user `c4757259aa3441e384ccfc57543ef01f`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:37.608685 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-370dfa05-da23-495d-a29c-4ade3c195578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:37.672362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1318/2639] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:37.676832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.738505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3a7ba3-44f4-4a4d-80d4-9396dbfffc59 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.743234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.743897 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.744188 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.744500 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.745209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.747732 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.757270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:37.774998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1322/2640] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/projects => generated 405 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:37.779287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dfa05-da23-495d-a29c-4ade3c195578 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.790003 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370dfa05-da23-495d-a29c-4ade3c195578 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.794858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:37.846794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.847468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.847756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.848037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.848768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.850680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.870106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1319/2641] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:37 2022] POST /identity/v3/users => generated 309 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:37.874616 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.884758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135ab63-1937-40ab-8ec3-9d9524cdf427 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.889740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.890453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.890758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.891015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.891742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.893369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.904066 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1323/2642] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:37.908116 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.918011 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a23538-d194-4c47-b3e6-9433c7036860 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:37.923545 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:37.924358 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:37.924698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:37.924983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] PATH_INFO: `/v3/projects/9c98c2bf8e7b49109bc0d51a83c097e3/users/f1bec155d1e0473c994a3c43d52e4474/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:37.940120 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c98c2bf8e7b49109bc0d51a83c097e3, user_id=f1bec155d1e0473c994a3c43d52e4474, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:37.942803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:37.956157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1320/2643] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:37 2022] PUT /identity/v3/projects/9c98c2bf8e7b49109bc0d51a83c097e3/users/f1bec155d1e0473c994a3c43d52e4474/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:37.959997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:37.970151 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510f3349-601a-48e4-b4ba-955152cd59cc admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:38.027451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65a55c2-e133-4e4f-a286-ce91812b6894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:38.028122 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a55c2-e133-4e4f-a286-ce91812b6894 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.028527 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a55c2-e133-4e4f-a286-ce91812b6894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.028814 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a55c2-e133-4e4f-a286-ce91812b6894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.029545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a55c2-e133-4e4f-a286-ce91812b6894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:38.031159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65a55c2-e133-4e4f-a286-ce91812b6894 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:38.040993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1324/2644] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:38.045727 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:38.055943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480c36ee-8b9c-4ebe-aa4f-51fe87964913 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:38.060785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:38.061660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.061948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.062232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] PATH_INFO: `/v3/projects/9c98c2bf8e7b49109bc0d51a83c097e3/users/f1bec155d1e0473c994a3c43d52e4474/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.064207 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c98c2bf8e7b49109bc0d51a83c097e3, user_id=f1bec155d1e0473c994a3c43d52e4474, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:38.066961 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:38.077549 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1321/2645] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:38 2022] PUT /identity/v3/projects/9c98c2bf8e7b49109bc0d51a83c097e3/users/f1bec155d1e0473c994a3c43d52e4474/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:38.088885 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f240-8183-417f-b5c5-e28c8ca8921d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.089178 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f240-8183-417f-b5c5-e28c8ca8921d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.089466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f240-8183-417f-b5c5-e28c8ca8921d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.116134 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6923f240-8183-417f-b5c5-e28c8ca8921d None None] MFA Rules not processed for user `f1bec155d1e0473c994a3c43d52e4474`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:38.117363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6923f240-8183-417f-b5c5-e28c8ca8921d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:38.185149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1325/2646] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:38 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:38.195629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:38.197327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:38.259497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2753f2-6d16-48a5-b02d-5f99e33ff128 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:38.263652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f276a-9280-4b9e-99ae-267dff71963e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:38.264295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f276a-9280-4b9e-99ae-267dff71963e service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.264610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f276a-9280-4b9e-99ae-267dff71963e service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.264899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f276a-9280-4b9e-99ae-267dff71963e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.273942 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f276a-9280-4b9e-99ae-267dff71963e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:38.275365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f276a-9280-4b9e-99ae-267dff71963e service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:38.285989 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1322/2647] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:38 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:38.431698 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f240-8183-417f-b5c5-e28c8ca8921d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:38.492873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f240-8183-417f-b5c5-e28c8ca8921d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:38.497455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:38.498423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.498717 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.499019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] PATH_INFO: `/v3/users/c4757259aa3441e384ccfc57543ef01f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.500166 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4757259aa3441e384ccfc57543ef01f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:38.502126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:38.504370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:38.549255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4757259aa3441e384ccfc57543ef01f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:38.556154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4757259aa3441e384ccfc57543ef01f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:38.556801 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4757259aa3441e384ccfc57543ef01f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:38.557440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4757259aa3441e384ccfc57543ef01f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:38.569617 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4757259aa3441e384ccfc57543ef01f'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:38.581942 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1326/2648] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:38 2022] DELETE /identity/v3/users/c4757259aa3441e384ccfc57543ef01f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:38.586426 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.586812 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.587096 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.605215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:38.606394 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:38.664310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1323/2649] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:07:38.679327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:38.680878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:38.739242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8584b4c-3bf5-45be-bb92-cdbcc010f6aa admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:38.742868 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:38.743561 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:38.743795 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:38.744069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:38.753205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:38.754636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:38.763775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1327/2650] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:39.024781 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:39.026208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:39.034967 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:39.040434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c988a261-f53b-439c-ad7e-276995eb0837 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:39.045949 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:39.046832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.047122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.047402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] PATH_INFO: `/v3/projects/59ca3b77825e4331aefe410767310639` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.048639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ca3b77825e4331aefe410767310639)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:39.050552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:39.099749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ca3b77825e4331aefe410767310639', 'request_id': 'req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.107057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ca3b77825e4331aefe410767310639', 'request_id': 'req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.113516 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ca3b77825e4331aefe410767310639', 'request_id': 'req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.125067 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] The token cache is being invalidate because project 59ca3b77825e4331aefe410767310639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:39.125362 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.126002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.127559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1324/2651] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:39 2022] DELETE /identity/v3/projects/59ca3b77825e4331aefe410767310639 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:39.131605 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:39.141257 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fbd508-9558-4d25-9a6a-c7d956c077ad service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:39.198623 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:39.199495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.199821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.200196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] PATH_INFO: `/v3/users/f1bec155d1e0473c994a3c43d52e4474` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.201721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1bec155d1e0473c994a3c43d52e4474)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:39.203773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:39.231747 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:39.253103 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1bec155d1e0473c994a3c43d52e4474'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.260855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1bec155d1e0473c994a3c43d52e4474'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.261474 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1bec155d1e0473c994a3c43d52e4474'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.262090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1bec155d1e0473c994a3c43d52e4474'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.275152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-64270a15-e75a-4dd3-aad7-7552170a14db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1bec155d1e0473c994a3c43d52e4474'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.288072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1328/2652] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:39 2022] DELETE /identity/v3/users/f1bec155d1e0473c994a3c43d52e4474 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:39.559443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:39.561150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:39.574498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6b1e81-6e91-4708-a193-c4d0a92a52c2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:39.632669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:39.633535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.633827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.634114 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] PATH_INFO: `/v3/projects/9c98c2bf8e7b49109bc0d51a83c097e3` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.635324 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c98c2bf8e7b49109bc0d51a83c097e3)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:39.637275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:39.683694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c98c2bf8e7b49109bc0d51a83c097e3', 'request_id': 'req-c29cb54d-12cb-4714-94f8-85c5b8bd8345'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.690500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c98c2bf8e7b49109bc0d51a83c097e3', 'request_id': 'req-c29cb54d-12cb-4714-94f8-85c5b8bd8345'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.696026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c98c2bf8e7b49109bc0d51a83c097e3', 'request_id': 'req-c29cb54d-12cb-4714-94f8-85c5b8bd8345'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.707569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] The token cache is being invalidate because project 9c98c2bf8e7b49109bc0d51a83c097e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:39.707858 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.708524 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-c29cb54d-12cb-4714-94f8-85c5b8bd8345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:39.710126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1325/2653] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:39 2022] DELETE /identity/v3/projects/9c98c2bf8e7b49109bc0d51a83c097e3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:39.715040 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842950f-a0b0-475d-9e79-6ee510767ba6 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.715361 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842950f-a0b0-475d-9e79-6ee510767ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.715642 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842950f-a0b0-475d-9e79-6ee510767ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.734506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0842950f-a0b0-475d-9e79-6ee510767ba6 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:39.735705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0842950f-a0b0-475d-9e79-6ee510767ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:39.794737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1329/2654] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:39.802714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180cb99-2e60-4fb1-a3eb-25a18e2faec2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.802940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180cb99-2e60-4fb1-a3eb-25a18e2faec2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.803228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b180cb99-2e60-4fb1-a3eb-25a18e2faec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.821898 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-b180cb99-2e60-4fb1-a3eb-25a18e2faec2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:39.823104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b180cb99-2e60-4fb1-a3eb-25a18e2faec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:39.831944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1326/2655] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:07:39.836070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842950f-a0b0-475d-9e79-6ee510767ba6 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:39.845950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842950f-a0b0-475d-9e79-6ee510767ba6 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:39.850544 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:39.851200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.851490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.851770 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.852543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:39.852922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:39.854649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:39.866638 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1330/2656] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:39.870912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180cb99-2e60-4fb1-a3eb-25a18e2faec2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:39.881129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b180cb99-2e60-4fb1-a3eb-25a18e2faec2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:39.885948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:39.886624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.886915 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.887196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.887931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:39.890150 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:39.898469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:39.919459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1327/2657] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:39 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:39.922834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:39.933025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0207e4e-e607-49f6-b997-6affefe8605a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:39.991061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:39.991738 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:39.992024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:39.992304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:39.993030 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:39.995115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.020671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1331/2658] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:39 2022] POST /identity/v3/users => generated 302 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:40.022098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.033345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0aaedd-359e-4cf4-b79a-e93e58a38d3f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.038089 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.038755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.039058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.039334 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.040056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.041682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.052270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1328/2659] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:40.056327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.067665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db97db2c-4fca-4dfe-8f42-cde38d560aa6 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.072538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503bcf4-e2b0-426e-80e1-b362f3eab6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.073199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503bcf4-e2b0-426e-80e1-b362f3eab6fd admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.073488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503bcf4-e2b0-426e-80e1-b362f3eab6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.073777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503bcf4-e2b0-426e-80e1-b362f3eab6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.074509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503bcf4-e2b0-426e-80e1-b362f3eab6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.076120 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503bcf4-e2b0-426e-80e1-b362f3eab6fd admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.088434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1332/2660] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:40.091363 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.102303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a43f68-4228-4299-b917-3380281bfce7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.107640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.108587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.108876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.109172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] PATH_INFO: `/v3/projects/24cc17d605fa4aaaabf9503f8f0c8b82/users/b86f0c37d03444aea0efd093a47a5ec5/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.124403 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24cc17d605fa4aaaabf9503f8f0c8b82, user_id=b86f0c37d03444aea0efd093a47a5ec5, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.127156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.141083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1329/2661] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:40 2022] PUT /identity/v3/projects/24cc17d605fa4aaaabf9503f8f0c8b82/users/b86f0c37d03444aea0efd093a47a5ec5/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:40.146460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c32f8b-87db-4b12-a2b1-dd8b34ef91be None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.146961 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c32f8b-87db-4b12-a2b1-dd8b34ef91be None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.147060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c32f8b-87db-4b12-a2b1-dd8b34ef91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.165654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-84c32f8b-87db-4b12-a2b1-dd8b34ef91be None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:40.166946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-84c32f8b-87db-4b12-a2b1-dd8b34ef91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:40.172224 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:40.240023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1333/2662] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:40.248415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:40.250808 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:40.319772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3069e-dea4-49d5-95f1-a567865fa119 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:40.324602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:40.325382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:40.325768 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:40.326143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:40.341730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:40.344488 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:40.354453 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1330/2663] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:41.007776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328bc3-7964-4d23-9b2c-b8b5a6bb89e9 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:41.008076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328bc3-7964-4d23-9b2c-b8b5a6bb89e9 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:41.008356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d328bc3-7964-4d23-9b2c-b8b5a6bb89e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:41.037373 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-5d328bc3-7964-4d23-9b2c-b8b5a6bb89e9 None None] MFA Rules not processed for user `b86f0c37d03444aea0efd093a47a5ec5`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:41.038606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-5d328bc3-7964-4d23-9b2c-b8b5a6bb89e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:41.116657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1334/2664] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:41 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:41.122033 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:41.132505 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d33360-f486-4d9b-b698-5199c82ced2b service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:41.137322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:41.138036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:41.138428 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:41.139302 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:41.140236 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:41.142219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:41.169552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1331/2665] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:41 2022] POST /identity/v3/projects => generated 403 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:41.175012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328bc3-7964-4d23-9b2c-b8b5a6bb89e9 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:41.187421 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d328bc3-7964-4d23-9b2c-b8b5a6bb89e9 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:41.244706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:41.245372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:41.245660 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:41.245936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:41.246622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:41.249107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:41.269956 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1335/2666] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:41 2022] POST /identity/v3/users => generated 308 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:41.273975 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:41.284714 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef71d2eb-5035-44e6-88c0-6bb26bbc3ba0 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:41.289290 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:41.289943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:41.290350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:41.290514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:41.291306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:41.292835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:41.303686 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1332/2667] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:41.307742 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:41.318264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1cf5b-8f83-416c-a726-82e72e06ea0d admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:41.322848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:41.323715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:41.324001 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:41.324277 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] PATH_INFO: `/v3/projects/a18afce530b04911b3b197452283283f/users/0873283868d5462ab1c8f1d66069fe66/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:41.340204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18afce530b04911b3b197452283283f, user_id=0873283868d5462ab1c8f1d66069fe66, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:41.342974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:41.357242 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1336/2668] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:41 2022] PUT /identity/v3/projects/a18afce530b04911b3b197452283283f/users/0873283868d5462ab1c8f1d66069fe66/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:41.361352 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:41.373929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11eb3f3-24af-4897-bd0b-d95f77927cd5 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:41.436106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2acdc7-0a54-4868-b085-d0c83d0d8a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:41.436760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2acdc7-0a54-4868-b085-d0c83d0d8a33 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:41.437170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2acdc7-0a54-4868-b085-d0c83d0d8a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:41.437454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2acdc7-0a54-4868-b085-d0c83d0d8a33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:41.438187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2acdc7-0a54-4868-b085-d0c83d0d8a33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:41.439785 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2acdc7-0a54-4868-b085-d0c83d0d8a33 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:41.449940 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1333/2669] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:41.455367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:41.463074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:41.467059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f041092c-9cc8-4146-8104-0958517f28ae admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:41.473085 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:41.474276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:41.474626 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:41.474974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] PATH_INFO: `/v3/projects/a18afce530b04911b3b197452283283f/users/0873283868d5462ab1c8f1d66069fe66/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:41.477099 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a18afce530b04911b3b197452283283f, user_id=0873283868d5462ab1c8f1d66069fe66, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:41.479835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:41.491759 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1337/2670] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:41 2022] PUT /identity/v3/projects/a18afce530b04911b3b197452283283f/users/0873283868d5462ab1c8f1d66069fe66/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:42.293163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7556693-8d1b-433a-9b69-07ae07784415 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:42.293705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7556693-8d1b-433a-9b69-07ae07784415 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:42.293705 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7556693-8d1b-433a-9b69-07ae07784415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:42.321996 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-e7556693-8d1b-433a-9b69-07ae07784415 None None] MFA Rules not processed for user `0873283868d5462ab1c8f1d66069fe66`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:42.323233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e7556693-8d1b-433a-9b69-07ae07784415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:42.338703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:42.421878 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1334/2671] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:42 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:43.496364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:43.562914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e214d5f-9994-476a-91ed-cba1daa89ddd admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:43.567532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:43.568480 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:43.568718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:43.568995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] PATH_INFO: `/v3/users/b86f0c37d03444aea0efd093a47a5ec5` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:43.570195 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=b86f0c37d03444aea0efd093a47a5ec5)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:43.572108 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:43.619401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b86f0c37d03444aea0efd093a47a5ec5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:43.627385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b86f0c37d03444aea0efd093a47a5ec5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:43.628254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b86f0c37d03444aea0efd093a47a5ec5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:43.628946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b86f0c37d03444aea0efd093a47a5ec5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:43.642902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b86f0c37d03444aea0efd093a47a5ec5'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:43.656703 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1338/2672] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:43 2022] DELETE /identity/v3/users/b86f0c37d03444aea0efd093a47a5ec5 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:43.851744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7556693-8d1b-433a-9b69-07ae07784415 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:43.864376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7556693-8d1b-433a-9b69-07ae07784415 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:43.926180 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:43.927041 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:43.927330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:43.927602 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] PATH_INFO: `/v3/projects/24cc17d605fa4aaaabf9503f8f0c8b82` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:43.928829 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=24cc17d605fa4aaaabf9503f8f0c8b82)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:43.930730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:43.977894 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24cc17d605fa4aaaabf9503f8f0c8b82', 'request_id': 'req-de2eeed0-6445-44a8-a5d6-142545c7f9ac'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:43.985556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24cc17d605fa4aaaabf9503f8f0c8b82', 'request_id': 'req-de2eeed0-6445-44a8-a5d6-142545c7f9ac'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:43.991065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24cc17d605fa4aaaabf9503f8f0c8b82', 'request_id': 'req-de2eeed0-6445-44a8-a5d6-142545c7f9ac'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.002148 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] The token cache is being invalidate because project 24cc17d605fa4aaaabf9503f8f0c8b82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:44.002437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.003104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.004652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1335/2673] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:43 2022] DELETE /identity/v3/projects/24cc17d605fa4aaaabf9503f8f0c8b82 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:44.008664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:44.010335 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:44.024087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe912e2-9589-454a-8a8e-47df7bc564ce admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:44.087838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:44.089086 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:44.089603 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:44.090088 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] PATH_INFO: `/v3/users/0873283868d5462ab1c8f1d66069fe66` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:44.091873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0873283868d5462ab1c8f1d66069fe66)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:44.094862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:44.128996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:44.194870 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0873283868d5462ab1c8f1d66069fe66'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.206272 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0873283868d5462ab1c8f1d66069fe66'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.206902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0873283868d5462ab1c8f1d66069fe66'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.207622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0873283868d5462ab1c8f1d66069fe66'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.228944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-17ba22b4-122f-47aa-8ed6-728d856aaac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0873283868d5462ab1c8f1d66069fe66'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.245152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1339/2674] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:44 2022] DELETE /identity/v3/users/0873283868d5462ab1c8f1d66069fe66 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:44.504754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:44.506349 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:44.520224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2eeed0-6445-44a8-a5d6-142545c7f9ac admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:44.575571 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:44.605617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:44.606482 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:44.606763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:44.607037 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] PATH_INFO: `/v3/projects/a18afce530b04911b3b197452283283f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:44.608595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a18afce530b04911b3b197452283283f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:44.610550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:44.664058 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a18afce530b04911b3b197452283283f', 'request_id': 'req-fca05087-443e-4987-8a64-256ec51a31f1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.675386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a18afce530b04911b3b197452283283f', 'request_id': 'req-fca05087-443e-4987-8a64-256ec51a31f1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.682751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a18afce530b04911b3b197452283283f', 'request_id': 'req-fca05087-443e-4987-8a64-256ec51a31f1'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.696411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] The token cache is being invalidate because project a18afce530b04911b3b197452283283f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:44.696700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.697407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-fca05087-443e-4987-8a64-256ec51a31f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:44.699113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1336/2675] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:44 2022] DELETE /identity/v3/projects/a18afce530b04911b3b197452283283f => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:44.708248 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ed11-4f74-4dd7-8ee3-0ddce1d3d05a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:44.709863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ed11-4f74-4dd7-8ee3-0ddce1d3d05a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:44.710534 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66ed11-4f74-4dd7-8ee3-0ddce1d3d05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:44.738550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1e66ed11-4f74-4dd7-8ee3-0ddce1d3d05a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:44.740354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1e66ed11-4f74-4dd7-8ee3-0ddce1d3d05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:44.805764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1340/2676] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:07:44.814907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428b011-b908-49d7-9956-35b967de6e89 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:44.815200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428b011-b908-49d7-9956-35b967de6e89 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:44.815481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428b011-b908-49d7-9956-35b967de6e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:44.835840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7428b011-b908-49d7-9956-35b967de6e89 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:44.837166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7428b011-b908-49d7-9956-35b967de6e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:44.846287 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1337/2677] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:44.850143 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ed11-4f74-4dd7-8ee3-0ddce1d3d05a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:44.861741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66ed11-4f74-4dd7-8ee3-0ddce1d3d05a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:44.866557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:44.867229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:44.867522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:44.867805 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:44.868627 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:44.868944 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:44.870578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:44.883533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1341/2678] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:44.888026 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428b011-b908-49d7-9956-35b967de6e89 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:44.898103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428b011-b908-49d7-9956-35b967de6e89 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:44.903161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:44.903827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:44.904128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:44.905068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:44.905771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:44.907657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:44.933927 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1338/2679] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:44 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:44.938404 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:44.948945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb76f8e-78be-403d-b044-81ce6d167ebf admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.009239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.009966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.010244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.010530 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.011265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.013250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.042848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1342/2680] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:44 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:45.043950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.054692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5078d-7eb9-4a70-9a85-fa4f6c5226f1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.059737 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.060473 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.061285 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.061561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.062411 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.064053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.075343 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1339/2681] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:45.087803 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.099222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24388e-7e50-415c-a68f-0aabf767f7c1 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.107196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa8775-eb71-434b-9e7f-22b01d107dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.108375 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa8775-eb71-434b-9e7f-22b01d107dda admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.108844 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa8775-eb71-434b-9e7f-22b01d107dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.109279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa8775-eb71-434b-9e7f-22b01d107dda admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.110436 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa8775-eb71-434b-9e7f-22b01d107dda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.113372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa8775-eb71-434b-9e7f-22b01d107dda admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.115429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:45.130973 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1343/2682] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:45.134713 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.146238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704efa42-f3d2-4e5d-95e8-e2beb072ca04 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.151445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.152407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.152707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.152988 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] PATH_INFO: `/v3/projects/138fa04b62d043bb9841a37e98ac1c41/users/c0e7f62775464140bd6d3f97c87fabfc/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.170215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] RBAC: Authorizing `identity:create_grant(project_id=138fa04b62d043bb9841a37e98ac1c41, user_id=c0e7f62775464140bd6d3f97c87fabfc, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.173173 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.187104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1340/2683] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:45 2022] PUT /identity/v3/projects/138fa04b62d043bb9841a37e98ac1c41/users/c0e7f62775464140bd6d3f97c87fabfc/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:45.197609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20525d-3243-4852-ba31-e2ed6a91495d None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.197896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20525d-3243-4852-ba31-e2ed6a91495d None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.198183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d20525d-3243-4852-ba31-e2ed6a91495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.224435 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-6d20525d-3243-4852-ba31-e2ed6a91495d None None] MFA Rules not processed for user `c0e7f62775464140bd6d3f97c87fabfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:45.225664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6d20525d-3243-4852-ba31-e2ed6a91495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:45.290250 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1344/2684] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:45.294750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.360623 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab3986f-f181-47e3-82c4-67c5fc47b1af admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.365368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.366038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.366328 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.366609 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.367317 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.369399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.374125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:45.403186 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1341/2685] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:45 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:45.404035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20525d-3243-4852-ba31-e2ed6a91495d None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.415010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d20525d-3243-4852-ba31-e2ed6a91495d None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.485778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.486468 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.486760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.487056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.487762 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.489813 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.514878 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1345/2686] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:45 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:07:45.516167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.526826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f9222-1b5e-4607-bce3-9d7eca22365a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.532555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.533244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.533533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.533811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.534535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.536108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.546750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1342/2687] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:45.550692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.560641 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b020d1-e0f3-4647-a331-6b289e26c3df admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.565239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.566126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.566412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.566695 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] PATH_INFO: `/v3/projects/a0960efa3d3d427abb1c0de01151293a/users/29929d122ccd418092d7490baf7da0d6/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.582389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0960efa3d3d427abb1c0de01151293a, user_id=29929d122ccd418092d7490baf7da0d6, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.585093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.599965 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1346/2688] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:45 2022] PUT /identity/v3/projects/a0960efa3d3d427abb1c0de01151293a/users/29929d122ccd418092d7490baf7da0d6/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:45.604127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.618811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04fa24-076e-408e-a4af-4ddc3944e8a8 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.680885 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7c9f96-f400-4ff0-b492-e4d4beb4b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.681629 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9f96-f400-4ff0-b492-e4d4beb4b2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.681920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9f96-f400-4ff0-b492-e4d4beb4b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.682204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7c9f96-f400-4ff0-b492-e4d4beb4b2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.682936 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9f96-f400-4ff0-b492-e4d4beb4b2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.684566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7c9f96-f400-4ff0-b492-e4d4beb4b2bc admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.700814 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1343/2689] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:45.705213 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.716215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d196147a-7d47-4142-85fe-808ec69fd6da admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.721397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.722296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.722585 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.722872 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] PATH_INFO: `/v3/projects/a0960efa3d3d427abb1c0de01151293a/users/29929d122ccd418092d7490baf7da0d6/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.724908 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0960efa3d3d427abb1c0de01151293a, user_id=29929d122ccd418092d7490baf7da0d6, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.727572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.738674 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1347/2690] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:45 2022] PUT /identity/v3/projects/a0960efa3d3d427abb1c0de01151293a/users/29929d122ccd418092d7490baf7da0d6/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:45.750801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742417-0f28-44c1-98f7-b891148b26e1 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.751099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742417-0f28-44c1-98f7-b891148b26e1 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.751386 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20742417-0f28-44c1-98f7-b891148b26e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.780897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-20742417-0f28-44c1-98f7-b891148b26e1 None None] MFA Rules not processed for user `29929d122ccd418092d7490baf7da0d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:45.782125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-20742417-0f28-44c1-98f7-b891148b26e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:45.854876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1344/2691] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:45 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:45.866176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:45.868192 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:45.912883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:45.931363 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05deb875-8994-4565-b283-00d9ee3c40f4 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:45.935254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f5b7f-c2c2-422e-9e73-3573c863fe01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:45.936304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5b7f-c2c2-422e-9e73-3573c863fe01 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:45.936628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5b7f-c2c2-422e-9e73-3573c863fe01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:45.936909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5b7f-c2c2-422e-9e73-3573c863fe01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:45.946300 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f5b7f-c2c2-422e-9e73-3573c863fe01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:45.947741 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f5b7f-c2c2-422e-9e73-3573c863fe01 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:45.957503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1348/2692] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:45 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:46.388535 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742417-0f28-44c1-98f7-b891148b26e1 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:46.461735 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:46.467489 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20742417-0f28-44c1-98f7-b891148b26e1 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:46.476865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:46.477784 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:46.478059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:46.478340 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] PATH_INFO: `/v3/users/c0e7f62775464140bd6d3f97c87fabfc` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:46.480359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e7f62775464140bd6d3f97c87fabfc)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:46.492977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:46.552212 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e7f62775464140bd6d3f97c87fabfc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:46.560118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e7f62775464140bd6d3f97c87fabfc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:46.572892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e7f62775464140bd6d3f97c87fabfc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:46.573646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e7f62775464140bd6d3f97c87fabfc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:46.581904 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e7f62775464140bd6d3f97c87fabfc'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:46.588498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1345/2693] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:46 2022] DELETE /identity/v3/users/c0e7f62775464140bd6d3f97c87fabfc => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:46.593323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:46.594031 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:46.594325 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:46.615328 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:46.617079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:46.681243 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1349/2694] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:46.694968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:46.696304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:46.758414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93554e84-28f2-4853-932d-1767209e334c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:46.762170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:46.762826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:46.763117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:46.763422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:46.773090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:46.774772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:46.788481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1346/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:47.079270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:47.080843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:47.105330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ede056-967c-4ce3-b6cb-1ac1f4db7e02 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:47.113193 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:47.114139 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:47.114964 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:47.115323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] PATH_INFO: `/v3/projects/138fa04b62d043bb9841a37e98ac1c41` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:47.116576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=138fa04b62d043bb9841a37e98ac1c41)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:47.118523 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:47.168078 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '138fa04b62d043bb9841a37e98ac1c41', 'request_id': 'req-1c14090e-894a-48f7-b980-dc3070a43676'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.175504 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '138fa04b62d043bb9841a37e98ac1c41', 'request_id': 'req-1c14090e-894a-48f7-b980-dc3070a43676'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.183673 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '138fa04b62d043bb9841a37e98ac1c41', 'request_id': 'req-1c14090e-894a-48f7-b980-dc3070a43676'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.195261 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] The token cache is being invalidate because project 138fa04b62d043bb9841a37e98ac1c41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:47.195547 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.196219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1c14090e-894a-48f7-b980-dc3070a43676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.197816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1350/2696] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:47 2022] DELETE /identity/v3/projects/138fa04b62d043bb9841a37e98ac1c41 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:47.202643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:47.212541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8624d45-f718-44df-97db-69358ef5c70a service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:47.271223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:47.272094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:47.272376 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:47.272679 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] PATH_INFO: `/v3/users/29929d122ccd418092d7490baf7da0d6` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:47.274115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29929d122ccd418092d7490baf7da0d6)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:47.276019 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:47.299007 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:47.329717 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29929d122ccd418092d7490baf7da0d6'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.337917 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29929d122ccd418092d7490baf7da0d6'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.351141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29929d122ccd418092d7490baf7da0d6'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.351764 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29929d122ccd418092d7490baf7da0d6'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.358911 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29929d122ccd418092d7490baf7da0d6'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.365095 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1347/2697] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:47 2022] DELETE /identity/v3/users/29929d122ccd418092d7490baf7da0d6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:47.432157 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732a3ce-40de-4de5-b9fb-743a15204c33 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:47.432601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732a3ce-40de-4de5-b9fb-743a15204c33 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:47.432891 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732a3ce-40de-4de5-b9fb-743a15204c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:47.455880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1732a3ce-40de-4de5-b9fb-743a15204c33 None None] MFA Rules not processed for user `eaffb1d48ff64ad498e65b3d0bb7677c`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:47.457539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1732a3ce-40de-4de5-b9fb-743a15204c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:47.520015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1351/2698] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:47.679436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:47.682274 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:47.764318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e446e569-eeaa-4484-827c-c42134a5a206 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:47.769151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:47.770010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:47.770294 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:47.770576 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] PATH_INFO: `/v3/projects/a0960efa3d3d427abb1c0de01151293a` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:47.771753 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0960efa3d3d427abb1c0de01151293a)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:47.773947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:47.824644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0960efa3d3d427abb1c0de01151293a', 'request_id': 'req-2fe19268-53d6-41b0-8a08-bcb64a55cebf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.833338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0960efa3d3d427abb1c0de01151293a', 'request_id': 'req-2fe19268-53d6-41b0-8a08-bcb64a55cebf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.840170 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0960efa3d3d427abb1c0de01151293a', 'request_id': 'req-2fe19268-53d6-41b0-8a08-bcb64a55cebf'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.852228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] The token cache is being invalidate because project a0960efa3d3d427abb1c0de01151293a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:47.852554 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.853235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-2fe19268-53d6-41b0-8a08-bcb64a55cebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:47.854776 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1348/2699] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:47 2022] DELETE /identity/v3/projects/a0960efa3d3d427abb1c0de01151293a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:47.860306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3447-79d7-4012-a456-297bb22f9e1e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:47.860639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3447-79d7-4012-a456-297bb22f9e1e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:47.860920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f3447-79d7-4012-a456-297bb22f9e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:47.879863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7d8f3447-79d7-4012-a456-297bb22f9e1e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:47.881080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7d8f3447-79d7-4012-a456-297bb22f9e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:47.885730 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:47.947307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1352/2700] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:07:47.955458 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee754-81c5-45d3-9b51-6f3c6a2cc1f0 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:47.955753 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee754-81c5-45d3-9b51-6f3c6a2cc1f0 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:47.956040 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ee754-81c5-45d3-9b51-6f3c6a2cc1f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:47.976736 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f42ee754-81c5-45d3-9b51-6f3c6a2cc1f0 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:47.978020 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f42ee754-81c5-45d3-9b51-6f3c6a2cc1f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:47.986970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1349/2701] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:47.991212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f3447-79d7-4012-a456-297bb22f9e1e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.001181 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f3447-79d7-4012-a456-297bb22f9e1e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.005740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.006396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.006682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.006960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.007687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:48.007997 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.009662 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.025069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1353/2702] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:48.026638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ee754-81c5-45d3-9b51-6f3c6a2cc1f0 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.037224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ee754-81c5-45d3-9b51-6f3c6a2cc1f0 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.042512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.043244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.043604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.043957 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.044815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.047440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.068941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:48.077598 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1350/2703] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/projects => generated 387 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:48.081506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.092234 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69946b1b-29a8-4095-b803-1ab0cccea883 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.160578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.161255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.161624 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.161863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.162560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.164508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.188307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1354/2704] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:48.192416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.207268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3b20b-282b-44d5-9f3d-cd3cf21a6ca4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.213702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.214360 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.214641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.214920 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.216601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.219826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.231614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1351/2705] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:48.236000 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.246496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467332ca-9d9c-4dc2-ae84-6a2d9d8977cf admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.251200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dae518-30f9-4a17-b77a-db3c14942e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.251864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae518-30f9-4a17-b77a-db3c14942e1c admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.252149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae518-30f9-4a17-b77a-db3c14942e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.252471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dae518-30f9-4a17-b77a-db3c14942e1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.253203 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dae518-30f9-4a17-b77a-db3c14942e1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.254791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dae518-30f9-4a17-b77a-db3c14942e1c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.265282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1355/2706] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:48.269995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.282445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e750ce4b-f37b-4da3-81d4-01c996cf0f95 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.287130 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.288001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.288297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.288793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] PATH_INFO: `/v3/projects/0a9c89a84dd643f598bdde4ebef89bfd/users/045bbfc92248409789420cf2b6c63e86/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.303850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a9c89a84dd643f598bdde4ebef89bfd, user_id=045bbfc92248409789420cf2b6c63e86, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.306631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.322270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1352/2707] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:48 2022] PUT /identity/v3/projects/0a9c89a84dd643f598bdde4ebef89bfd/users/045bbfc92248409789420cf2b6c63e86/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:48.333745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9c1c-ac16-4178-a88f-e3aa3c3f7a10 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.334038 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9c1c-ac16-4178-a88f-e3aa3c3f7a10 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.334316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0da9c1c-ac16-4178-a88f-e3aa3c3f7a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.363508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e0da9c1c-ac16-4178-a88f-e3aa3c3f7a10 None None] MFA Rules not processed for user `045bbfc92248409789420cf2b6c63e86`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:48.364764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e0da9c1c-ac16-4178-a88f-e3aa3c3f7a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:48.434758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1356/2708] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:48.439962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.506929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ababa0d-fe31-4d25-873d-88e6e3f56159 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.511958 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.512647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.512947 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.513210 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.514491 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.516368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.541365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1353/2709] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/projects => generated 387 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:48.546191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9c1c-ac16-4178-a88f-e3aa3c3f7a10 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.552993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:48.558018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0da9c1c-ac16-4178-a88f-e3aa3c3f7a10 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.619013 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.619690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.619974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.620253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.620980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.623029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.643629 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1357/2710] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:48.647876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.659772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691367ba-177e-4e12-8b3d-f9efbad7e750 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.664432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.665091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.665373 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.665648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.666369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.667939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.678840 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1354/2711] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:48.682905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.693761 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f19e02-7aa3-4988-8483-a29fee320e3e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.698525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475c0c38-cc31-40b9-a27f-011c40237ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.699458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c0c38-cc31-40b9-a27f-011c40237ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.699745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c0c38-cc31-40b9-a27f-011c40237ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.700024 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475c0c38-cc31-40b9-a27f-011c40237ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.700785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c0c38-cc31-40b9-a27f-011c40237ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.703205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475c0c38-cc31-40b9-a27f-011c40237ba0 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.716475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1358/2712] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:48.718682 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.729090 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652106fa-07f2-4502-842c-c974dda31518 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.734388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.735261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.735542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.735818 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] PATH_INFO: `/v3/projects/e8eb7d58d2fc4f558c4397bb14947639/users/270b3304156d41568a538ea0231c6fa4/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.752077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8eb7d58d2fc4f558c4397bb14947639, user_id=270b3304156d41568a538ea0231c6fa4, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.754807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.768590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1355/2713] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:48 2022] PUT /identity/v3/projects/e8eb7d58d2fc4f558c4397bb14947639/users/270b3304156d41568a538ea0231c6fa4/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:48.781860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e84d6-69fc-41bb-9f99-d94fd1403248 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.782141 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e84d6-69fc-41bb-9f99-d94fd1403248 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.782492 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7e84d6-69fc-41bb-9f99-d94fd1403248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.809696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-1f7e84d6-69fc-41bb-9f99-d94fd1403248 None None] MFA Rules not processed for user `270b3304156d41568a538ea0231c6fa4`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:48.811069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1f7e84d6-69fc-41bb-9f99-d94fd1403248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:48.876678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1359/2714] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:48.881228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.943070 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139f9282-ff0f-4f39-8c3c-2ef538864d16 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:48.947628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:48.948275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:48.948588 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:48.948867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:48.949552 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:48.951423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:48.970613 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:48.981295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1356/2715] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:48.983159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e84d6-69fc-41bb-9f99-d94fd1403248 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:48.994025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7e84d6-69fc-41bb-9f99-d94fd1403248 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:49.052655 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:49.053330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:49.053607 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:49.053888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:49.054591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:49.056538 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:49.077039 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1360/2716] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:48 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:49.081305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:49.093546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447ac28-730b-4ae7-bea3-0fd5705db3b7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:49.098487 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:49.099159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:49.099466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:49.099752 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:49.100519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:49.103129 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:49.118907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1357/2717] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:49.120514 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:49.126828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:49.132916 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a8c10-1574-49a7-b0ef-4edae45a643f admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:49.139900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:49.140986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:49.141828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:49.141828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] PATH_INFO: `/v3/projects/0ca12f7046f5432f97d0c0e2f9ef4fc0/users/567f49feda6f4b798be64edf620c2912/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:49.159512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca12f7046f5432f97d0c0e2f9ef4fc0, user_id=567f49feda6f4b798be64edf620c2912, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:49.162429 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:49.176557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1361/2718] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:49 2022] PUT /identity/v3/projects/0ca12f7046f5432f97d0c0e2f9ef4fc0/users/567f49feda6f4b798be64edf620c2912/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:49.180631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:49.191425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9132226-f50b-4e98-b1ec-a645f5994a64 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:49.267329 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6aedd0-0099-4f75-b1aa-2efa4dfe4eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:49.268015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aedd0-0099-4f75-b1aa-2efa4dfe4eee admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:49.268305 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aedd0-0099-4f75-b1aa-2efa4dfe4eee admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:49.268637 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6aedd0-0099-4f75-b1aa-2efa4dfe4eee admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:49.269375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aedd0-0099-4f75-b1aa-2efa4dfe4eee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:49.271140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6aedd0-0099-4f75-b1aa-2efa4dfe4eee admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:49.283152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1358/2719] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:49.287869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:49.302169 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc6e23-037f-4f8e-9281-c1cd5270bb05 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:49.307275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:49.308180 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:49.308520 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:49.308802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] PATH_INFO: `/v3/projects/0ca12f7046f5432f97d0c0e2f9ef4fc0/users/567f49feda6f4b798be64edf620c2912/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:49.311535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ca12f7046f5432f97d0c0e2f9ef4fc0, user_id=567f49feda6f4b798be64edf620c2912, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:49.314412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:49.325771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1362/2720] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:49 2022] PUT /identity/v3/projects/0ca12f7046f5432f97d0c0e2f9ef4fc0/users/567f49feda6f4b798be64edf620c2912/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:49.336258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:49.336731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:49.337185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:49.365210 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] MFA Rules not processed for user `567f49feda6f4b798be64edf620c2912`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:49.366425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:49.438237 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1359/2721] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:49.448933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:49.450709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:49.513555 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77889f0d-3410-4a96-b910-34996d27d4bc admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:49.517396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:49.517929 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:49.518212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:49.518487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:49.528485 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:49.531089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:49.541095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1363/2722] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:49 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:50.004799 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:50.006303 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:50.065140 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:50.067358 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:50.077860 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6fbb4-9879-41b8-867c-0969c96682cc None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:50.079513 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6641c9d8-2e1f-4853-b371-ecc3f6a391c3 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:50.085402 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:50.086086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:50.086388 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:50.086690 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:50.088624 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:50.089445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:50.090142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:50.090433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:50.090718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:50.099769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:50.101526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:50.111771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1360/2723] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:50.153060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:50.155456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:50.164687 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1364/2724] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:07:54.212083 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:54.221409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2c6bd-11a2-49b7-b974-69d8ac10c396 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:54.225055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca5934-a001-4c14-b0a8-dd9b486fd69b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:54.225699 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5934-a001-4c14-b0a8-dd9b486fd69b service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:54.225995 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5934-a001-4c14-b0a8-dd9b486fd69b service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:54.226288 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca5934-a001-4c14-b0a8-dd9b486fd69b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:54.235855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:54.290869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5934-a001-4c14-b0a8-dd9b486fd69b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:54.293523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aca5934-a001-4c14-b0a8-dd9b486fd69b service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:54.303851 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1361/2725] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:54 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:56.419680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:56.498604 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc06787-2c17-4eeb-b749-da37cf96f2b6 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:56.510145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:56.511048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:56.511337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:56.511583 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] PATH_INFO: `/v3/users/045bbfc92248409789420cf2b6c63e86` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:56.512831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=045bbfc92248409789420cf2b6c63e86)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:56.514971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:56.520915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:56.570028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045bbfc92248409789420cf2b6c63e86'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:56.577722 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045bbfc92248409789420cf2b6c63e86'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:56.578362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045bbfc92248409789420cf2b6c63e86'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:56.579095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045bbfc92248409789420cf2b6c63e86'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:56.592992 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045bbfc92248409789420cf2b6c63e86'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:56.605420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1365/2726] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:56 2022] DELETE /identity/v3/users/045bbfc92248409789420cf2b6c63e86 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:56.610443 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:56.610944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:56.611071 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:56.627968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:56.629229 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:56.689972 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1362/2727] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:56.699873 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:56.701397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:56.758613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481dd895-9167-42fc-a093-60eec20e1e86 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:56.762249 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:56.762900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:56.763191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:56.764019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:56.773049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:56.774726 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:56.784969 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1366/2728] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:57.073059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.074660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:57.094469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6100f461-a092-46c2-bd29-ce23c6dd3720 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.099356 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.100444 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.100743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.101024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] PATH_INFO: `/v3/projects/0a9c89a84dd643f598bdde4ebef89bfd` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.102418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a9c89a84dd643f598bdde4ebef89bfd)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.105223 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:57.164698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a9c89a84dd643f598bdde4ebef89bfd', 'request_id': 'req-b877582f-9019-4b9b-9295-8c02ac79d6a2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.173743 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a9c89a84dd643f598bdde4ebef89bfd', 'request_id': 'req-b877582f-9019-4b9b-9295-8c02ac79d6a2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.181027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a9c89a84dd643f598bdde4ebef89bfd', 'request_id': 'req-b877582f-9019-4b9b-9295-8c02ac79d6a2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.193925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] The token cache is being invalidate because project 0a9c89a84dd643f598bdde4ebef89bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:57.194215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.194880 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.196461 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1363/2729] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:57 2022] DELETE /identity/v3/projects/0a9c89a84dd643f598bdde4ebef89bfd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:57.200705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.213236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447171db-0d30-475e-863d-01c6e7f0947a service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.277714 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.278505 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.278832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.279263 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] PATH_INFO: `/v3/users/270b3304156d41568a538ea0231c6fa4` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.280411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] RBAC: Authorizing `identity:delete_user(user_id=270b3304156d41568a538ea0231c6fa4)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.282697 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:57.327420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:57.344333 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270b3304156d41568a538ea0231c6fa4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.352570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270b3304156d41568a538ea0231c6fa4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.354337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270b3304156d41568a538ea0231c6fa4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.355010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270b3304156d41568a538ea0231c6fa4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.380080 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270b3304156d41568a538ea0231c6fa4'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.393477 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1367/2730] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:57 2022] DELETE /identity/v3/users/270b3304156d41568a538ea0231c6fa4 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:57.757890 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.759333 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:57.773034 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877582f-9019-4b9b-9295-8c02ac79d6a2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.810113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:57.837290 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.838157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.838441 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.838719 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] PATH_INFO: `/v3/projects/e8eb7d58d2fc4f558c4397bb14947639` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.839892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8eb7d58d2fc4f558c4397bb14947639)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.842084 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:57.887412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8eb7d58d2fc4f558c4397bb14947639', 'request_id': 'req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.894695 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8eb7d58d2fc4f558c4397bb14947639', 'request_id': 'req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.900555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8eb7d58d2fc4f558c4397bb14947639', 'request_id': 'req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.911245 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] The token cache is being invalidate because project e8eb7d58d2fc4f558c4397bb14947639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:57.911532 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.912161 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:57.914122 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1364/2731] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:57 2022] DELETE /identity/v3/projects/e8eb7d58d2fc4f558c4397bb14947639 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:57.917881 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:57.919392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:57.932998 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169ca0ad-6a90-4b76-9db1-02a653d9572e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:57.989608 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:57.990490 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:57.990782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:57.991068 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] PATH_INFO: `/v3/users/567f49feda6f4b798be64edf620c2912` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:57.992284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] RBAC: Authorizing `identity:delete_user(user_id=567f49feda6f4b798be64edf620c2912)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:57.994266 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.047664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '567f49feda6f4b798be64edf620c2912'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.054614 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '567f49feda6f4b798be64edf620c2912'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.055306 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '567f49feda6f4b798be64edf620c2912'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.055943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '567f49feda6f4b798be64edf620c2912'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.068900 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-43c7018d-3f02-4263-8ae3-859346762588 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '567f49feda6f4b798be64edf620c2912'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.080954 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1368/2732] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:57 2022] DELETE /identity/v3/users/567f49feda6f4b798be64edf620c2912 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:58.354848 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:58.356750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:58.370962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b257cfc-fb82-4f1d-9448-e46af7ed2b86 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:58.430616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:58.431943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.432262 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.432579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] PATH_INFO: `/v3/projects/0ca12f7046f5432f97d0c0e2f9ef4fc0` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.433823 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ca12f7046f5432f97d0c0e2f9ef4fc0)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:58.436194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.484769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ca12f7046f5432f97d0c0e2f9ef4fc0', 'request_id': 'req-1e6c069d-7755-4c21-b58a-59d81086b9de'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.492238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ca12f7046f5432f97d0c0e2f9ef4fc0', 'request_id': 'req-1e6c069d-7755-4c21-b58a-59d81086b9de'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.498744 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ca12f7046f5432f97d0c0e2f9ef4fc0', 'request_id': 'req-1e6c069d-7755-4c21-b58a-59d81086b9de'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.501432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:58.512910 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] The token cache is being invalidate because project 0ca12f7046f5432f97d0c0e2f9ef4fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:58.514078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.514760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-1e6c069d-7755-4c21-b58a-59d81086b9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:58.516311 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1365/2733] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:58 2022] DELETE /identity/v3/projects/0ca12f7046f5432f97d0c0e2f9ef4fc0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:58.522330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be349fba-0720-41eb-a8f0-2b8f3dd991c9 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.522631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be349fba-0720-41eb-a8f0-2b8f3dd991c9 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.522915 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be349fba-0720-41eb-a8f0-2b8f3dd991c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.542832 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-be349fba-0720-41eb-a8f0-2b8f3dd991c9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:58.544112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-be349fba-0720-41eb-a8f0-2b8f3dd991c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:58.564356 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:58.604838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1369/2734] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:58.614174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d41e-5fb5-4dba-8ec8-8c76def4bbbc None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.614468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d41e-5fb5-4dba-8ec8-8c76def4bbbc None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.614755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02d41e-5fb5-4dba-8ec8-8c76def4bbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.633139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-3e02d41e-5fb5-4dba-8ec8-8c76def4bbbc None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:58.634345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-3e02d41e-5fb5-4dba-8ec8-8c76def4bbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:58.642850 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1366/2735] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:58.647389 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be349fba-0720-41eb-a8f0-2b8f3dd991c9 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:58.658443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be349fba-0720-41eb-a8f0-2b8f3dd991c9 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:58.663286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:58.664089 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.664419 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.664710 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.669886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:07:58.669886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:58.669886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.681397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1370/2736] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:07:58.685692 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d41e-5fb5-4dba-8ec8-8c76def4bbbc None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:58.699999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02d41e-5fb5-4dba-8ec8-8c76def4bbbc None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:58.706099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:58.706760 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.707046 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.707330 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.708023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:58.709954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.736726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1367/2737] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:07:58 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:58.740719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:58.751720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93806af6-89b8-4c1f-bbad-9fb54b41623b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:58.810680 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:58.811433 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.811785 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.812131 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.812936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:58.814903 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.839519 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1371/2738] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:07:58 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:07:58.840708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:58.851202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69f8280-4ff4-463a-91ab-e9b105345966 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:58.855870 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:58.856509 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.856803 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.857605 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.858518 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:58.860091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.870547 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1368/2739] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 30 13:07:58.874815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:58.885200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa566c17-ef09-4de5-82a1-5b66e3fb69b0 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:58.890612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af01c13d-1b0f-445a-88fe-bbbf32a2838c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:58.891282 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c13d-1b0f-445a-88fe-bbbf32a2838c admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.891569 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c13d-1b0f-445a-88fe-bbbf32a2838c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.891851 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af01c13d-1b0f-445a-88fe-bbbf32a2838c admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.892618 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01c13d-1b0f-445a-88fe-bbbf32a2838c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:58.894225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af01c13d-1b0f-445a-88fe-bbbf32a2838c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.905799 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1372/2740] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:07:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:07:58.909879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:58.921335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a1e247-9bd0-4446-8691-f4ccc943fdd8 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:58.926384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:58.927276 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.927560 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.927845 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] PATH_INFO: `/v3/projects/2acc4dcb6abb4bdfac4128fb08fca06f/users/9c3e3f6d41d741e6ab0b9126f99401f0/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.943798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] RBAC: Authorizing `identity:create_grant(project_id=2acc4dcb6abb4bdfac4128fb08fca06f, user_id=9c3e3f6d41d741e6ab0b9126f99401f0, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:58.946616 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:58.959849 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1369/2741] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:07:58 2022] PUT /identity/v3/projects/2acc4dcb6abb4bdfac4128fb08fca06f/users/9c3e3f6d41d741e6ab0b9126f99401f0/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:07:58.971869 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a47e48-0a4b-43da-ac29-be4921a0d383 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:58.972464 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a47e48-0a4b-43da-ac29-be4921a0d383 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:58.972719 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a47e48-0a4b-43da-ac29-be4921a0d383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:58.999418 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-65a47e48-0a4b-43da-ac29-be4921a0d383 None None] MFA Rules not processed for user `9c3e3f6d41d741e6ab0b9126f99401f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:59.000682 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-65a47e48-0a4b-43da-ac29-be4921a0d383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:59.069496 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1373/2742] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:07:59.081354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:59.083659 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:59.140643 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e27a3-689f-42da-9ec5-8392c81d3ade admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:59.144202 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a7bc8-2d92-46eb-bf38-6a11aaafacee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:59.144873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a7bc8-2d92-46eb-bf38-6a11aaafacee service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.145159 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a7bc8-2d92-46eb-bf38-6a11aaafacee service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.145436 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a7bc8-2d92-46eb-bf38-6a11aaafacee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.155171 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a7bc8-2d92-46eb-bf38-6a11aaafacee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:59.156636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a7bc8-2d92-46eb-bf38-6a11aaafacee service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:59.166204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1370/2743] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:59.185745 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a47e48-0a4b-43da-ac29-be4921a0d383 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:59.212751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:59.253431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a47e48-0a4b-43da-ac29-be4921a0d383 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:59.259609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:59.260539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.260831 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.261113 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] PATH_INFO: `/v3/users/9c3e3f6d41d741e6ab0b9126f99401f0` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.262369 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3e3f6d41d741e6ab0b9126f99401f0)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:59.264574 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:59.314863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3e3f6d41d741e6ab0b9126f99401f0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.322631 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3e3f6d41d741e6ab0b9126f99401f0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.323273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3e3f6d41d741e6ab0b9126f99401f0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.323934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3e3f6d41d741e6ab0b9126f99401f0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.336939 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3e3f6d41d741e6ab0b9126f99401f0'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.350018 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1374/2744] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:07:59 2022] DELETE /identity/v3/users/9c3e3f6d41d741e6ab0b9126f99401f0 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:59.354454 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.354751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.355068 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.372567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:59.374126 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:59.437395 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1371/2745] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:07:59.447187 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:59.448757 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:59.519207 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614fdf6b-32e1-4f28-ba32-ad0fa2d34a1d admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:59.522932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3e64-dfa1-48ca-9dab-ae5cfaa2f5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:59.523601 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3e64-dfa1-48ca-9dab-ae5cfaa2f5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.524145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3e64-dfa1-48ca-9dab-ae5cfaa2f5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.524458 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3e64-dfa1-48ca-9dab-ae5cfaa2f5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.534410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3e64-dfa1-48ca-9dab-ae5cfaa2f5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:59.535855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3e64-dfa1-48ca-9dab-ae5cfaa2f5c1 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:59.545839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1375/2746] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:07:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:07:59.850745 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:07:59.852226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:07:59.865468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d47fe9-ff87-4dd2-b347-415984021cce None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:07:59.871371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:07:59.872252 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.872592 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.872916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] PATH_INFO: `/v3/projects/2acc4dcb6abb4bdfac4128fb08fca06f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.874355 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2acc4dcb6abb4bdfac4128fb08fca06f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:07:59.876484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:07:59.924295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:07:59.940708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2acc4dcb6abb4bdfac4128fb08fca06f', 'request_id': 'req-a5ac29b8-344f-441b-9434-b457bbb3e6c9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.948483 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2acc4dcb6abb4bdfac4128fb08fca06f', 'request_id': 'req-a5ac29b8-344f-441b-9434-b457bbb3e6c9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.955027 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2acc4dcb6abb4bdfac4128fb08fca06f', 'request_id': 'req-a5ac29b8-344f-441b-9434-b457bbb3e6c9'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.967082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] The token cache is being invalidate because project 2acc4dcb6abb4bdfac4128fb08fca06f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:07:59.967082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.967740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-a5ac29b8-344f-441b-9434-b457bbb3e6c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:07:59.969589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1372/2747] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:07:59 2022] DELETE /identity/v3/projects/2acc4dcb6abb4bdfac4128fb08fca06f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:07:59.974399 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f25b8-80c1-4658-b2db-e90359554737 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:07:59.974898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f25b8-80c1-4658-b2db-e90359554737 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:07:59.974996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4f25b8-80c1-4658-b2db-e90359554737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:07:59.996007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-7b4f25b8-80c1-4658-b2db-e90359554737 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:07:59.997342 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7b4f25b8-80c1-4658-b2db-e90359554737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:00.039852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:00.061978 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1376/2748] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:07:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:08:00.069669 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336e93f-438a-4fd1-9af9-57427f28a7a2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.069998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336e93f-438a-4fd1-9af9-57427f28a7a2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.070283 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336e93f-438a-4fd1-9af9-57427f28a7a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.089459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-d336e93f-438a-4fd1-9af9-57427f28a7a2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:00.092712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d336e93f-438a-4fd1-9af9-57427f28a7a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:00.102657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1373/2749] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:08:00.109383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f25b8-80c1-4658-b2db-e90359554737 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.120057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4f25b8-80c1-4658-b2db-e90359554737 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.126850 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.127600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.127974 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.128247 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.129076 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:08:00.129392 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.131298 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.145607 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1377/2750] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:08:00.149826 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336e93f-438a-4fd1-9af9-57427f28a7a2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.159675 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336e93f-438a-4fd1-9af9-57427f28a7a2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.165918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.166694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.167049 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.167400 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.168258 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.170772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.199916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1374/2751] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:08:00 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:08:00.204295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.215702 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12189928-c8cc-4965-858b-0ea1b85c7d45 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.281669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.282787 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.283229 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.283661 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.284558 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.286664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.309898 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1378/2752] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:08:00 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:08:00.314707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.326432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bfb7fc-fb36-48b5-bd10-48560664da34 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.331991 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.332801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.333226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.334100 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.334923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.337140 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.348584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1375/2753] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:08:00.353628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.367304 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a17fd-3158-4ff5-90c4-eaff5560ad38 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.372159 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95764bf3-82a9-421a-9ca9-54c6e20501ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.373690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764bf3-82a9-421a-9ca9-54c6e20501ed admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.373981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764bf3-82a9-421a-9ca9-54c6e20501ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.374275 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95764bf3-82a9-421a-9ca9-54c6e20501ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.375002 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95764bf3-82a9-421a-9ca9-54c6e20501ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.376649 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95764bf3-82a9-421a-9ca9-54c6e20501ed admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.387910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1379/2754] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:08:00 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:08:00.391985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.403062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdf74ba-021b-4f21-bf0f-62db9ff1df23 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.411156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.412178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.412459 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.412740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] PATH_INFO: `/v3/projects/0c37909b2fc4422ebdd2f3e311dd63d0/users/b252e4f23727420096bcd159e9d8b7dc/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.434000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c37909b2fc4422ebdd2f3e311dd63d0, user_id=b252e4f23727420096bcd159e9d8b7dc, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.437227 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.453512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1376/2755] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:08:00 2022] PUT /identity/v3/projects/0c37909b2fc4422ebdd2f3e311dd63d0/users/b252e4f23727420096bcd159e9d8b7dc/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:08:00.464185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19feeb5-311f-46fb-9690-b46cfd5b4f2c None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.464551 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19feeb5-311f-46fb-9690-b46cfd5b4f2c None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.464833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19feeb5-311f-46fb-9690-b46cfd5b4f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.495385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a19feeb5-311f-46fb-9690-b46cfd5b4f2c None None] MFA Rules not processed for user `b252e4f23727420096bcd159e9d8b7dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:00.496654 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a19feeb5-311f-46fb-9690-b46cfd5b4f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:00.578130 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1380/2756] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:08:00.591272 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.593596 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:00.659625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2293d1-7175-488d-a10b-ac2ff2801cc0 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.663435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093e2557-1de7-46ec-ab18-e50c22721c3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.664228 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e2557-1de7-46ec-ab18-e50c22721c3f service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.664646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e2557-1de7-46ec-ab18-e50c22721c3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.668143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093e2557-1de7-46ec-ab18-e50c22721c3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.677902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e2557-1de7-46ec-ab18-e50c22721c3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.679479 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093e2557-1de7-46ec-ab18-e50c22721c3f service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.700495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1377/2757] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:08:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:08:00.718069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19feeb5-311f-46fb-9690-b46cfd5b4f2c None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:00.770215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:00.798035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19feeb5-311f-46fb-9690-b46cfd5b4f2c None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:00.802957 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:00.803860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.804147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.805423 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] PATH_INFO: `/v3/users/b252e4f23727420096bcd159e9d8b7dc` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.806107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b252e4f23727420096bcd159e9d8b7dc)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:00.808060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:00.864439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b252e4f23727420096bcd159e9d8b7dc'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:00.874265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b252e4f23727420096bcd159e9d8b7dc'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:00.874936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b252e4f23727420096bcd159e9d8b7dc'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:00.875562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b252e4f23727420096bcd159e9d8b7dc'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:00.890230 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b252e4f23727420096bcd159e9d8b7dc'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:00.903155 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1381/2758] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:08:00 2022] DELETE /identity/v3/users/b252e4f23727420096bcd159e9d8b7dc => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:08:00.907567 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eed8b-5426-4017-a988-2695582c8321 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:00.908043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eed8b-5426-4017-a988-2695582c8321 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:00.908139 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007eed8b-5426-4017-a988-2695582c8321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:00.926632 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-007eed8b-5426-4017-a988-2695582c8321 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:00.927881 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-007eed8b-5426-4017-a988-2695582c8321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:00.979492 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:00.994754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1378/2759] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:08:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:08:01.002450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:01.003934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:01.067835 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343485b7-6f05-4b4a-9e25-c9555282e026 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:01.071536 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1215b5-4243-45b6-a202-2486110d7430 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:01.072196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1215b5-4243-45b6-a202-2486110d7430 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:01.072522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1215b5-4243-45b6-a202-2486110d7430 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:01.072808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1215b5-4243-45b6-a202-2486110d7430 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:01.082778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1215b5-4243-45b6-a202-2486110d7430 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:01.084262 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1215b5-4243-45b6-a202-2486110d7430 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:01.093914 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1382/2760] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:08:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:08:01.393304 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eed8b-5426-4017-a988-2695582c8321 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:08:01.394854 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-007eed8b-5426-4017-a988-2695582c8321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:01.408141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007eed8b-5426-4017-a988-2695582c8321 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:08:01.412901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:08:01.413806 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:01.414099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:01.414399 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] PATH_INFO: `/v3/projects/0c37909b2fc4422ebdd2f3e311dd63d0` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:01.415626 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c37909b2fc4422ebdd2f3e311dd63d0)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:08:01.417591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:08:01.467136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c37909b2fc4422ebdd2f3e311dd63d0', 'request_id': 'req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:01.474591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c37909b2fc4422ebdd2f3e311dd63d0', 'request_id': 'req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:01.480185 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c37909b2fc4422ebdd2f3e311dd63d0', 'request_id': 'req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:01.491169 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] The token cache is being invalidate because project 0c37909b2fc4422ebdd2f3e311dd63d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:08:01.491462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:01.492094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:08:01.493653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1379/2761] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:08:01 2022] DELETE /identity/v3/projects/0c37909b2fc4422ebdd2f3e311dd63d0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:08:11.089475 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=61,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:11.488109 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=28,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:08:41.192288 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:08:41.192862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:08:41.192862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:08:41.211352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] MFA Rules not processed for user `eaffb1d48ff64ad498e65b3d0bb7677c`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:08:41.212632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:08:41.267977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1383/2762] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:08:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:08:51.260716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=25 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:10:47.094984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:10:47.096377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:47.165593 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd12c92-ba60-4c44-b4ba-bdbc50cc731b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:10:47.170634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:10:47.171282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:10:47.171633 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:10:47.171902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:10:47.173617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:10:47.185464 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:10:47.187023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:10:47.197810 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1380/2763] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:10:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:10:57.192722 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=32 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:11:51.081264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:11:51.082675 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:51.138949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf281ec-b74c-4aac-8a25-ecc38208812b None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:11:51.142503 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:11:51.143142 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:11:51.143428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:11:51.143705 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:11:51.145470 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:11:51.157258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:11:51.158665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:11:51.167487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1384/2764] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:11:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:12:01.163455 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=26 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:15:49.094680 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:15:49.096077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:15:49.161899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8759e9-e456-46fa-a223-445c7aaeee4c service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:15:49.167016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:15:49.167656 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:15:49.167945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:15:49.168224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:15:49.177375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:15:49.178935 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:15:49.188782 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1381/2765] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:15:49 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:15:59.184468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=28 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:16:51.086919 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:16:51.115560 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c483af38-c997-4181-8e3e-22b0200394d9 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:16:51.119245 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:16:51.119889 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:16:51.120179 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:16:51.120557 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:16:51.130215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:16:51.131689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:16:51.159201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1385/2766] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:16:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:17:01.156610 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=22 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:20:50.045523 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:20:50.047136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:50.134561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8a519-2c49-4e56-8f80-2f88dd29c512 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:20:50.139766 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:20:50.140437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:20:50.140733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:20:50.141018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:20:50.142923 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:20:50.154913 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:20:50.156500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:20:50.166264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1382/2767] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:20:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:21:00.162053 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=41 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:21:51.167316 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:21:51.169901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:51.237764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e193fbe-493e-481f-8314-8b6047f08fbd service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:21:51.241431 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:21:51.242081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:21:51.242372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:21:51.242659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:21:51.244573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:21:51.316781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:21:51.318226 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:21:51.327925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1386/2768] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:21:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:22:01.323072 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=58 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:25:58.133261 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:25:58.134833 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:25:58.205365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c16e0-f67d-48fe-a94d-05d30946c129 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:25:58.210698 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:25:58.211350 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:25:58.211642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:25:58.211926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:25:58.221621 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:25:58.223241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:25:58.233520 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1383/2769] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:25:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:26:08.228907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=28 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:26:51.313453 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:26:51.332582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3678f80-2c5b-477d-b658-fe18ec3d10e2 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:26:51.336427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:26:51.337075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:26:51.337359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:26:51.337637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:26:51.347254 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:26:51.348729 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:26:51.376121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1387/2770] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:26:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:01.373394 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=17 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:29.228664 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:29.230555 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:29.308769 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fed1db-8e1f-455d-b438-e05599baa3f7 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:29.312299 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:29.312966 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:29.313255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:29.313537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:29.315384 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:29.396772 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:29.398232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:29.417625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1384/2771] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:32.535899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:32.560999 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb4494a-fb34-4929-aed9-ed38abb56830 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:32.571450 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:32.572128 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:32.572456 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:32.572752 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:32.574924 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:32.588194 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:32.591186 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:32.602228 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1388/2772] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:32 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:32.616579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:32.618561 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:32.633861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17401f-dbb8-404d-95c8-63895736272b service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:32.639877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:32.640789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:32.641080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:32.641361 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] PATH_INFO: `/v3/users/eaffb1d48ff64ad498e65b3d0bb7677c` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:32.642562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eaffb1d48ff64ad498e65b3d0bb7677c)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:32.644528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:32.699733 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eaffb1d48ff64ad498e65b3d0bb7677c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:32.707422 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eaffb1d48ff64ad498e65b3d0bb7677c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:32.709589 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:32.722521 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eaffb1d48ff64ad498e65b3d0bb7677c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:32.723166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eaffb1d48ff64ad498e65b3d0bb7677c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:32.731106 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-14c8b4c9-02e3-47aa-adeb-66580ae99a53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eaffb1d48ff64ad498e65b3d0bb7677c'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:32.737028 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1385/2773] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:32 2022] DELETE /identity/v3/users/eaffb1d48ff64ad498e65b3d0bb7677c => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:32.913172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:32.924410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44c8b4-e190-427b-aa4e-975962c2c45b service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:32.981883 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:32.982737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:32.983023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:32.983311 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] PATH_INFO: `/v3/projects/4e0c064dd8974c069dd8d3afd8b48fb3` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:32.984553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e0c064dd8974c069dd8d3afd8b48fb3)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:32.986672 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.044107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e0c064dd8974c069dd8d3afd8b48fb3', 'request_id': 'req-dc82e43b-a957-4068-b394-ca9f157b9235'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:33.050359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e0c064dd8974c069dd8d3afd8b48fb3', 'request_id': 'req-dc82e43b-a957-4068-b394-ca9f157b9235'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:33.059902 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e0c064dd8974c069dd8d3afd8b48fb3', 'request_id': 'req-dc82e43b-a957-4068-b394-ca9f157b9235'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:33.070545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] The token cache is being invalidate because project 4e0c064dd8974c069dd8d3afd8b48fb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:33.070839 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:33.071476 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-dc82e43b-a957-4068-b394-ca9f157b9235 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:33.073582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1389/2774] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:32 2022] DELETE /identity/v3/projects/4e0c064dd8974c069dd8d3afd8b48fb3 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:27:33.079761 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a4c2-6fa1-41cf-a933-98abb6b01b46 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.080061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a4c2-6fa1-41cf-a933-98abb6b01b46 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.080341 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d6a4c2-6fa1-41cf-a933-98abb6b01b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.141540 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-05d6a4c2-6fa1-41cf-a933-98abb6b01b46 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:33.142771 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-05d6a4c2-6fa1-41cf-a933-98abb6b01b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:33.203559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1386/2775] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:27:33.211460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25169b6-6bfb-476c-a580-99b8f571e80a None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.211758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25169b6-6bfb-476c-a580-99b8f571e80a None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.212047 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25169b6-6bfb-476c-a580-99b8f571e80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.231371 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-e25169b6-6bfb-476c-a580-99b8f571e80a None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:33.232862 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-e25169b6-6bfb-476c-a580-99b8f571e80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:33.241320 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1390/2776] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:33.245606 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6a4c2-6fa1-41cf-a933-98abb6b01b46 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.255336 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d6a4c2-6fa1-41cf-a933-98abb6b01b46 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.259954 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.261174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.261618 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.261907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] PATH_INFO: `/v3/domains` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.262634 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80104) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:27:33.262951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.264641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.277136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1387/2777] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:27:33.281861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25169b6-6bfb-476c-a580-99b8f571e80a None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.291051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25169b6-6bfb-476c-a580-99b8f571e80a None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.295864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.296562 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.296858 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.297145 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.297842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.299750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.335548 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1391/2778] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:27:33 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:33.340338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.350282 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b57672-c1ea-42a6-85c6-3a5ced2bd911 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.407750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.408345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.408660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.408941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.409658 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.411605 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.434985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1388/2779] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:27:33 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:33.436202 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.446767 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb1e97-d7e2-4370-94be-c1255d102819 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.452299 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.452977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.453267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.453550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.454286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.455893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.466149 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1392/2780] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:33.470196 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.481151 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d4a879-2f03-4bc3-8784-da06ffe3b273 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.485925 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98968d9-e409-4322-889f-738a82a7ffe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.486579 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98968d9-e409-4322-889f-738a82a7ffe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.486872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98968d9-e409-4322-889f-738a82a7ffe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.487156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98968d9-e409-4322-889f-738a82a7ffe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.487879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98968d9-e409-4322-889f-738a82a7ffe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.489495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98968d9-e409-4322-889f-738a82a7ffe4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.500348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1389/2781] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:33.504303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.514815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee40cdf4-1ef6-4f66-b13d-67f06fa6c90d admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.519509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.520407 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.520830 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.521117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] PATH_INFO: `/v3/projects/1eec5a8578c84951ab9edbbedbc49a90/users/4f93b75d1b2141e2bb83d67f5c918845/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.536146 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] RBAC: Authorizing `identity:create_grant(project_id=1eec5a8578c84951ab9edbbedbc49a90, user_id=4f93b75d1b2141e2bb83d67f5c918845, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.538852 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.552215 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1393/2782] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:33 2022] PUT /identity/v3/projects/1eec5a8578c84951ab9edbbedbc49a90/users/4f93b75d1b2141e2bb83d67f5c918845/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:33.562660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f687af-a34f-4ba1-a4d7-91db517a8776 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.563050 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f687af-a34f-4ba1-a4d7-91db517a8776 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.563339 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f687af-a34f-4ba1-a4d7-91db517a8776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.582238 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:33.593471 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-96f687af-a34f-4ba1-a4d7-91db517a8776 None None] MFA Rules not processed for user `4f93b75d1b2141e2bb83d67f5c918845`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:33.594720 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-96f687af-a34f-4ba1-a4d7-91db517a8776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:33.661348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1390/2783] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:33.663901 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.669606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:33.728307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c0268-fd82-48e7-a620-e2dd9c2c6dab admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.733625 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.734286 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.734579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.734864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.735573 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.737525 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.765016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1394/2784] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:27:33 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:33.767709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f687af-a34f-4ba1-a4d7-91db517a8776 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.778902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f687af-a34f-4ba1-a4d7-91db517a8776 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.838044 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.838916 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.839268 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.839559 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] PATH_INFO: `/v3/users` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.840271 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.842234 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.867155 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1391/2785] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:27:33 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:33.868364 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.879198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1504e4fa-e1ee-4128-86a8-9e8ad7a9fc90 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.883781 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.884467 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.884754 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.885057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.886025 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.887622 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.897990 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1395/2786] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:33.902412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.912092 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce6aea-8c89-4b47-8b9c-2b621ce62919 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:33.917117 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:33.917962 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:33.918241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:33.918514 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] PATH_INFO: `/v3/projects/fe1d4981d7854b91a16775739fd93039/users/2eac8dc1d7d2450f8b297d43c7140581/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:33.934900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1d4981d7854b91a16775739fd93039, user_id=2eac8dc1d7d2450f8b297d43c7140581, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:33.937924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:33.950591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1392/2787] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:33 2022] PUT /identity/v3/projects/fe1d4981d7854b91a16775739fd93039/users/2eac8dc1d7d2450f8b297d43c7140581/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:33.954612 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:33.964711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf3b4f4-ed37-404b-9700-8d183c88ef70 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:34.019931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e29bfa-60b5-47d8-b666-9dbdac6aab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:34.020618 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29bfa-60b5-47d8-b666-9dbdac6aab52 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.020912 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29bfa-60b5-47d8-b666-9dbdac6aab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.021197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e29bfa-60b5-47d8-b666-9dbdac6aab52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.021931 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29bfa-60b5-47d8-b666-9dbdac6aab52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:34.023535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e29bfa-60b5-47d8-b666-9dbdac6aab52 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:34.034415 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1396/2788] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:34.037410 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:34.048055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1491022-db8b-4ed5-8577-5e09fb745985 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:34.052708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:34.053578 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.053869 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.054146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] PATH_INFO: `/v3/projects/fe1d4981d7854b91a16775739fd93039/users/2eac8dc1d7d2450f8b297d43c7140581/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.056123 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1d4981d7854b91a16775739fd93039, user_id=2eac8dc1d7d2450f8b297d43c7140581, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:34.059365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:34.069372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1393/2789] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:34 2022] PUT /identity/v3/projects/fe1d4981d7854b91a16775739fd93039/users/2eac8dc1d7d2450f8b297d43c7140581/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:27:34.079345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d478c-9f6c-4afc-a706-3ebb6e1ca6da None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.079639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d478c-9f6c-4afc-a706-3ebb6e1ca6da None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.079925 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d478c-9f6c-4afc-a706-3ebb6e1ca6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.107212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b16d478c-9f6c-4afc-a706-3ebb6e1ca6da None None] MFA Rules not processed for user `2eac8dc1d7d2450f8b297d43c7140581`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:34.108466 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b16d478c-9f6c-4afc-a706-3ebb6e1ca6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:34.171995 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:34.176070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1397/2790] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:34 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:34.187397 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:34.189216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:34.245600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bae0d5-2f77-46fd-af91-a50b508b410f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:34.249407 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6157a2c3-ce24-4330-a5d2-8c343474e206 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:34.250043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157a2c3-ce24-4330-a5d2-8c343474e206 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.250335 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157a2c3-ce24-4330-a5d2-8c343474e206 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.250617 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6157a2c3-ce24-4330-a5d2-8c343474e206 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.256430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:34.262000 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157a2c3-ce24-4330-a5d2-8c343474e206 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:34.263774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6157a2c3-ce24-4330-a5d2-8c343474e206 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:34.273641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1394/2791] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:34 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:34.301980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d478c-9f6c-4afc-a706-3ebb6e1ca6da None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:34.366329 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d478c-9f6c-4afc-a706-3ebb6e1ca6da None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:34.371828 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:34.372735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.373035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.373318 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] PATH_INFO: `/v3/users/4f93b75d1b2141e2bb83d67f5c918845` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.374528 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f93b75d1b2141e2bb83d67f5c918845)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:34.376511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:34.422864 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f93b75d1b2141e2bb83d67f5c918845'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:34.429577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f93b75d1b2141e2bb83d67f5c918845'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:34.430182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f93b75d1b2141e2bb83d67f5c918845'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:34.430804 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f93b75d1b2141e2bb83d67f5c918845'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:34.442936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f93b75d1b2141e2bb83d67f5c918845'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:34.455800 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1398/2792] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:34 2022] DELETE /identity/v3/users/4f93b75d1b2141e2bb83d67f5c918845 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:34.460270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.460587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.460867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.478081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:34.479834 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:34.535418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1395/2793] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:27:34.545439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:34.546865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:34.603396 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c13de-c2fd-45f9-8857-1a9c9250be08 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:34.607549 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:34.608191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.608509 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.608797 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.617683 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:34.619104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:34.628438 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1399/2794] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:34.900368 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:34.901941 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:34.913664 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b63b565-7a68-49ba-8c36-172c819ca2b2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:34.918327 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:34.919928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:34.920216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:34.920706 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] PATH_INFO: `/v3/projects/1eec5a8578c84951ab9edbbedbc49a90` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:34.921921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1eec5a8578c84951ab9edbbedbc49a90)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:34.924670 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:34.974730 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1eec5a8578c84951ab9edbbedbc49a90', 'request_id': 'req-30085321-4e82-4ef3-b6f6-75cb1669faa2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:34.981842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1eec5a8578c84951ab9edbbedbc49a90', 'request_id': 'req-30085321-4e82-4ef3-b6f6-75cb1669faa2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:34.987466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1eec5a8578c84951ab9edbbedbc49a90', 'request_id': 'req-30085321-4e82-4ef3-b6f6-75cb1669faa2'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.001668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] The token cache is being invalidate because project 1eec5a8578c84951ab9edbbedbc49a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:35.001955 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.002610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.004165 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1396/2795] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:34 2022] DELETE /identity/v3/projects/1eec5a8578c84951ab9edbbedbc49a90 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:35.008115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:35.018526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7867fae-793b-41c3-bd6d-153db9d9e924 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:35.037182 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:35.078613 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:35.079487 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.079774 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.080057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] PATH_INFO: `/v3/users/2eac8dc1d7d2450f8b297d43c7140581` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.081284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2eac8dc1d7d2450f8b297d43c7140581)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:35.083255 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:35.128594 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2eac8dc1d7d2450f8b297d43c7140581'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.136212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2eac8dc1d7d2450f8b297d43c7140581'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.136880 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2eac8dc1d7d2450f8b297d43c7140581'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.137488 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2eac8dc1d7d2450f8b297d43c7140581'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.149148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9049ab06-0647-4202-a4f0-4f2193c5cd4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2eac8dc1d7d2450f8b297d43c7140581'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.166484 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1400/2796] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:35 2022] DELETE /identity/v3/users/2eac8dc1d7d2450f8b297d43c7140581 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:35.444688 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:35.446433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:35.466466 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30085321-4e82-4ef3-b6f6-75cb1669faa2 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:35.528541 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:35.529323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.529608 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.529888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] PATH_INFO: `/v3/projects/fe1d4981d7854b91a16775739fd93039` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.531088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1d4981d7854b91a16775739fd93039)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:35.534152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:35.555575 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:35.583484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1d4981d7854b91a16775739fd93039', 'request_id': 'req-ee9b40e0-0449-4f48-9e4b-29e536a92b84'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.592081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1d4981d7854b91a16775739fd93039', 'request_id': 'req-ee9b40e0-0449-4f48-9e4b-29e536a92b84'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.599375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1d4981d7854b91a16775739fd93039', 'request_id': 'req-ee9b40e0-0449-4f48-9e4b-29e536a92b84'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.610741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] The token cache is being invalidate because project fe1d4981d7854b91a16775739fd93039 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:35.611036 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.611681 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-ee9b40e0-0449-4f48-9e4b-29e536a92b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:35.613244 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1397/2797] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:35 2022] DELETE /identity/v3/projects/fe1d4981d7854b91a16775739fd93039 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:35.618075 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c0c0a-d56b-4563-91fe-1f9c2716570e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.618587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c0c0a-d56b-4563-91fe-1f9c2716570e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.618706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4c0c0a-d56b-4563-91fe-1f9c2716570e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.637550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-fd4c0c0a-d56b-4563-91fe-1f9c2716570e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:35.638743 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fd4c0c0a-d56b-4563-91fe-1f9c2716570e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:35.699056 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1401/2798] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 30 13:27:35.707944 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9e5f-6f12-49a1-81a9-413275a2f7f4 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.708239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9e5f-6f12-49a1-81a9-413275a2f7f4 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.708557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982f9e5f-6f12-49a1-81a9-413275a2f7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.727801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-982f9e5f-6f12-49a1-81a9-413275a2f7f4 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:35.729065 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-982f9e5f-6f12-49a1-81a9-413275a2f7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:35.737653 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1398/2799] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:35.741792 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c0c0a-d56b-4563-91fe-1f9c2716570e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:35.752049 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4c0c0a-d56b-4563-91fe-1f9c2716570e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:35.756711 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:35.757359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.757652 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.757933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.758670 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:27:35.758985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:35.761209 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:35.773098 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1402/2800] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:27:35.777604 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f9e5f-6f12-49a1-81a9-413275a2f7f4 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:35.788731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982f9e5f-6f12-49a1-81a9-413275a2f7f4 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:35.794056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:35.794726 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.795014 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.795298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.795994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:35.797950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:35.831445 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1399/2801] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:27:35 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:27:35.835690 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:35.847220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4276c35-9853-41d0-8a32-34863ee6918a admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:35.873222 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:35.906445 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:35.907117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.907410 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.907692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.908400 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:35.910337 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:35.930918 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1403/2802] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:27:35 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:35.935448 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:35.945928 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6f7d3c-8f5b-4a56-9e0c-87fee564a16d admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:35.951622 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:35.952276 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.952595 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.952886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.953607 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:35.955193 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:35.966064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1400/2803] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:35.969848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:35.981074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b3c2d-8c00-4a64-a894-d9d8770b0263 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:35.986162 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fac56-ffe2-4fd1-8190-f5abab8c4ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:35.986826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fac56-ffe2-4fd1-8190-f5abab8c4ea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:35.987115 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fac56-ffe2-4fd1-8190-f5abab8c4ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:35.987397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fac56-ffe2-4fd1-8190-f5abab8c4ea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:35.988135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fac56-ffe2-4fd1-8190-f5abab8c4ea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:35.989778 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fac56-ffe2-4fd1-8190-f5abab8c4ea3 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.000893 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1404/2804] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:36.005074 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.015073 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58811cf2-4efb-48f3-b6e5-ded297273caf admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.019657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.020562 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.020853 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.021136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] PATH_INFO: `/v3/projects/40478655e50d47a1b291b5db61031563/users/ddf36110a3ec4783a995bd9f5da12381/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.035639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40478655e50d47a1b291b5db61031563, user_id=ddf36110a3ec4783a995bd9f5da12381, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.038306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.051512 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1401/2805] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:36 2022] PUT /identity/v3/projects/40478655e50d47a1b291b5db61031563/users/ddf36110a3ec4783a995bd9f5da12381/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:36.062253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9627-b709-49e3-9a3d-a46bdc518477 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.062552 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9627-b709-49e3-9a3d-a46bdc518477 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.062836 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc9627-b709-49e3-9a3d-a46bdc518477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.089949 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-bacc9627-b709-49e3-9a3d-a46bdc518477 None None] MFA Rules not processed for user `ddf36110a3ec4783a995bd9f5da12381`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:36.091167 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bacc9627-b709-49e3-9a3d-a46bdc518477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:36.156198 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1405/2806] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:36.160982 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.221439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776f1ce7-5de2-49ec-b58a-63b0923abb56 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.226160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.226805 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.227094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.227382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.228076 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.230644 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.255929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1402/2807] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:27:36 2022] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:27:36.260055 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc9627-b709-49e3-9a3d-a46bdc518477 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.270782 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc9627-b709-49e3-9a3d-a46bdc518477 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.327081 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.327678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.327966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.328246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.328952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.330874 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.351279 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1406/2808] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:27:36 2022] POST /identity/v3/users => generated 306 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:27:36.355582 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.366154 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d270ec-3773-4282-a076-b52c3da63933 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.371345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.372002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.372293 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.372610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.373342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.374929 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.386174 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1403/2809] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:36.390352 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.400370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88803261-a09b-4279-a3b1-f269d786490b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.405259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.406127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.406416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.406692 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] PATH_INFO: `/v3/projects/00042c499c7540f9aa760320628a1cc6/users/6bb97b3e242c4258b5cd57f9c7327cee/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.422267 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=00042c499c7540f9aa760320628a1cc6, user_id=6bb97b3e242c4258b5cd57f9c7327cee, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.424945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.437715 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1407/2810] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:36 2022] PUT /identity/v3/projects/00042c499c7540f9aa760320628a1cc6/users/6bb97b3e242c4258b5cd57f9c7327cee/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:36.441636 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.452069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761eb17b-7be5-4b55-b3b8-344892eeb04a admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.464537 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:36.511166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078f60-c137-4a40-b38f-eff639f14c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.511837 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078f60-c137-4a40-b38f-eff639f14c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.512131 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078f60-c137-4a40-b38f-eff639f14c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.512440 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078f60-c137-4a40-b38f-eff639f14c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.513166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9078f60-c137-4a40-b38f-eff639f14c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.514763 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9078f60-c137-4a40-b38f-eff639f14c0f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.524369 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1404/2811] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:36.529518 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.534982 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:36.541220 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29535591-b9b2-4f9f-a189-ba28bb238b8c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.547117 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.548015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.548307 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.548620 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] PATH_INFO: `/v3/projects/00042c499c7540f9aa760320628a1cc6/users/6bb97b3e242c4258b5cd57f9c7327cee/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.550628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] RBAC: Authorizing `identity:create_grant(project_id=00042c499c7540f9aa760320628a1cc6, user_id=6bb97b3e242c4258b5cd57f9c7327cee, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.553296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.563791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1408/2812] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:36 2022] PUT /identity/v3/projects/00042c499c7540f9aa760320628a1cc6/users/6bb97b3e242c4258b5cd57f9c7327cee/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:36.573822 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa78b-b0bd-4ac9-88ca-de6a9fb6f419 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.574119 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa78b-b0bd-4ac9-88ca-de6a9fb6f419 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.574406 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8aa78b-b0bd-4ac9-88ca-de6a9fb6f419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.601233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-7b8aa78b-b0bd-4ac9-88ca-de6a9fb6f419 None None] MFA Rules not processed for user `6bb97b3e242c4258b5cd57f9c7327cee`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:36.602377 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7b8aa78b-b0bd-4ac9-88ca-de6a9fb6f419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:36.670115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1405/2813] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:36 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:36.681632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.683489 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:36.740273 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b92c-bb44-45bd-9792-a70afa75578b admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.743927 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.744598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.745060 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.745390 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.754405 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.755854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.765619 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1409/2814] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:36 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:36.835873 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa78b-b0bd-4ac9-88ca-de6a9fb6f419 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:36.846313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8aa78b-b0bd-4ac9-88ca-de6a9fb6f419 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:36.849978 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e07568-6084-419d-b874-a5011c21911b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:36.850597 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e07568-6084-419d-b874-a5011c21911b service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:36.850879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e07568-6084-419d-b874-a5011c21911b service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:36.851156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e07568-6084-419d-b874-a5011c21911b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:36.907414 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e07568-6084-419d-b874-a5011c21911b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:36.908801 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e07568-6084-419d-b874-a5011c21911b service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:36.917844 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1406/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:36 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:40.918223 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:40.979502 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6d1c7-3c9e-4262-83f5-40587b722587 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:40.984104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:40.985005 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:40.985297 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:40.985577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] PATH_INFO: `/v3/users/ddf36110a3ec4783a995bd9f5da12381` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:40.986775 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf36110a3ec4783a995bd9f5da12381)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:40.988731 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:41.041473 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf36110a3ec4783a995bd9f5da12381'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.048815 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf36110a3ec4783a995bd9f5da12381'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.049426 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf36110a3ec4783a995bd9f5da12381'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.050035 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf36110a3ec4783a995bd9f5da12381'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.062184 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf36110a3ec4783a995bd9f5da12381'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.074542 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1410/2816] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:40 2022] DELETE /identity/v3/users/ddf36110a3ec4783a995bd9f5da12381 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:41.078985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:41.079468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:41.079572 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:41.096943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:41.098162 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:41.130530 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:41.158306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1407/2817] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:41.168147 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:41.169581 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:41.183526 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:41.228966 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9101ddb6-5ef5-4500-9893-a3d2eb303f59 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:41.233606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:41.234191 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:41.234479 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:41.234765 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:41.243689 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:41.246259 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:41.255533 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1411/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:41.526970 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:41.528423 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:41.544181 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7ddc0-2b81-4b53-a4fa-234c1f5a7487 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:41.549166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:41.550059 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:41.550348 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:41.550631 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] PATH_INFO: `/v3/projects/40478655e50d47a1b291b5db61031563` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:41.551836 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40478655e50d47a1b291b5db61031563)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:41.553800 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:41.600912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40478655e50d47a1b291b5db61031563', 'request_id': 'req-533df2f8-2080-4e48-8694-d548f1437120'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.609125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40478655e50d47a1b291b5db61031563', 'request_id': 'req-533df2f8-2080-4e48-8694-d548f1437120'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.614931 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40478655e50d47a1b291b5db61031563', 'request_id': 'req-533df2f8-2080-4e48-8694-d548f1437120'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.626051 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] The token cache is being invalidate because project 40478655e50d47a1b291b5db61031563 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:41.626372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.627032 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.628599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1408/2819] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:41 2022] DELETE /identity/v3/projects/40478655e50d47a1b291b5db61031563 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:41.632669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:41.642176 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa65ca-3d0a-406a-9f7a-9413bf0c5b06 service neutron] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:41.701621 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:41.702498 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:41.702783 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:41.703059 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] PATH_INFO: `/v3/users/6bb97b3e242c4258b5cd57f9c7327cee` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:41.704235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb97b3e242c4258b5cd57f9c7327cee)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:41.706183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:41.752104 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb97b3e242c4258b5cd57f9c7327cee'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.759451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb97b3e242c4258b5cd57f9c7327cee'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.761009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb97b3e242c4258b5cd57f9c7327cee'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.761723 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb97b3e242c4258b5cd57f9c7327cee'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.773598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-37119cb3-43dc-418e-a7cf-44bfa4046c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb97b3e242c4258b5cd57f9c7327cee'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:41.785751 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1412/2820] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:27:41 2022] DELETE /identity/v3/users/6bb97b3e242c4258b5cd57f9c7327cee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:42.062796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.064243 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:42.078256 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533df2f8-2080-4e48-8694-d548f1437120 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.137043 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.137907 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.138191 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.138469 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] PATH_INFO: `/v3/projects/00042c499c7540f9aa760320628a1cc6` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.139641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=00042c499c7540f9aa760320628a1cc6)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.141591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.189016 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00042c499c7540f9aa760320628a1cc6', 'request_id': 'req-466afa11-604f-4360-bac8-b8a1dd38d9da'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:42.196099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00042c499c7540f9aa760320628a1cc6', 'request_id': 'req-466afa11-604f-4360-bac8-b8a1dd38d9da'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:42.201599 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:42.202884 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00042c499c7540f9aa760320628a1cc6', 'request_id': 'req-466afa11-604f-4360-bac8-b8a1dd38d9da'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:42.216504 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] The token cache is being invalidate because project 00042c499c7540f9aa760320628a1cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:27:42.216794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:42.217437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-466afa11-604f-4360-bac8-b8a1dd38d9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:27:42.218976 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1409/2821] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:27:42 2022] DELETE /identity/v3/projects/00042c499c7540f9aa760320628a1cc6 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:42.224009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cad80-ee46-48c7-a43c-15ba3fae0ac5 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.224472 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cad80-ee46-48c7-a43c-15ba3fae0ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.224600 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060cad80-ee46-48c7-a43c-15ba3fae0ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.242411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-060cad80-ee46-48c7-a43c-15ba3fae0ac5 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:42.243615 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-060cad80-ee46-48c7-a43c-15ba3fae0ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:42.272359 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:42.304854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1413/2822] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:42.312938 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6a37-ae11-4bfb-874d-7306bb0237f3 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.313172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6a37-ae11-4bfb-874d-7306bb0237f3 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.313457 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca6a37-ae11-4bfb-874d-7306bb0237f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.332477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-32ca6a37-ae11-4bfb-874d-7306bb0237f3 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:42.333678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-32ca6a37-ae11-4bfb-874d-7306bb0237f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:42.342694 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1410/2823] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:42.346928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cad80-ee46-48c7-a43c-15ba3fae0ac5 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.357124 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060cad80-ee46-48c7-a43c-15ba3fae0ac5 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.361706 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.362354 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.362646 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.362932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.363664 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:27:42.363977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.365611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.377632 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1414/2824] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:27:42.381789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca6a37-ae11-4bfb-874d-7306bb0237f3 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.392063 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca6a37-ae11-4bfb-874d-7306bb0237f3 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.396731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.397375 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.397661 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.397939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.398619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.400789 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.426057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1411/2825] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:27:42 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:42.429952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.440541 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4994c1-bdf4-462c-98d9-627d41054fc6 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.497716 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.498387 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.498678 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.498960 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.499666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.501639 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.522934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1415/2826] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:27:42 2022] POST /identity/v3/users => generated 287 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:42.529557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.539909 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22487147-c50c-4673-99e2-b6377012576c admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.544877 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.545544 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.545832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.546142 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.546902 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.548581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.559270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1412/2827] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:42.563221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.573718 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caee253-cf7a-40a2-99cf-030c90730a6d admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.578323 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745fdcf-bcc6-4a7d-928d-93df8b1b8f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.578980 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745fdcf-bcc6-4a7d-928d-93df8b1b8f97 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.579265 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745fdcf-bcc6-4a7d-928d-93df8b1b8f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.579543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745fdcf-bcc6-4a7d-928d-93df8b1b8f97 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.580268 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745fdcf-bcc6-4a7d-928d-93df8b1b8f97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.581887 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745fdcf-bcc6-4a7d-928d-93df8b1b8f97 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.592362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1416/2828] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:42.596531 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.606700 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72aa70e-a44c-47b3-858f-52dac9eead1e admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.611325 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.612190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.612507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.613080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] PATH_INFO: `/v3/projects/3ee1fc0eb51945b68e470fb3f80f2a84/users/b3a61950bf8a4e0e81553e17531f8167/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.628080 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ee1fc0eb51945b68e470fb3f80f2a84, user_id=b3a61950bf8a4e0e81553e17531f8167, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.631094 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.644354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1413/2829] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:42 2022] PUT /identity/v3/projects/3ee1fc0eb51945b68e470fb3f80f2a84/users/b3a61950bf8a4e0e81553e17531f8167/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:42.649867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e812533-7b01-4beb-befe-f8e3089fd984 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.650163 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e812533-7b01-4beb-befe-f8e3089fd984 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.650447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e812533-7b01-4beb-befe-f8e3089fd984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.668877 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-9e812533-7b01-4beb-befe-f8e3089fd984 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:42.670100 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-9e812533-7b01-4beb-befe-f8e3089fd984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:42.730506 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1417/2830] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:42.740415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:42.742160 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:42.798786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ec90f-57a7-42a5-b0ab-db4e09b2e0c1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:42.802484 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:42.803128 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:42.803418 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:42.803702 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:42.813517 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:42.814879 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:42.824468 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1414/2831] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:43.428936 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1962-6c5d-46bc-ac65-692782dc7229 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:43.429512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1962-6c5d-46bc-ac65-692782dc7229 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:43.429512 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a1962-6c5d-46bc-ac65-692782dc7229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:43.459816 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-876a1962-6c5d-46bc-ac65-692782dc7229 None None] MFA Rules not processed for user `b3a61950bf8a4e0e81553e17531f8167`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:43.461095 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-876a1962-6c5d-46bc-ac65-692782dc7229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:43.492284 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:43.534264 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1418/2832] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:43 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:43.538855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:43.549998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d977409d-a1f5-4dff-8750-65abad76a8cb service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:43.554569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:43.555225 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:43.555507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:43.555783 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:43.556533 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:43.559085 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:43.585447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1415/2833] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:27:43 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:43.590021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1962-6c5d-46bc-ac65-692782dc7229 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:43.600950 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a1962-6c5d-46bc-ac65-692782dc7229 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:43.659572 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:43.660253 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:43.660577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:43.660886 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:43.661588 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:43.663508 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:43.687556 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1419/2834] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:27:43 2022] POST /identity/v3/users => generated 292 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:27:43.688794 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:43.700460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7ebbe-1c99-48ff-8213-61424f7eb1c7 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:43.705195 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:43.705862 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:43.706152 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:43.706432 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:43.707156 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:43.708793 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:43.723619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1416/2835] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:43.725053 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:43.735720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee88ab61-bd1a-4871-ae5a-394166444cc7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:43.740413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:43.741296 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:43.741584 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:43.741865 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] PATH_INFO: `/v3/projects/31e34aa408e249fca651c2c413bae3d7/users/444c9d7d01984e33ba9b6511067b7a2c/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:43.756699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e34aa408e249fca651c2c413bae3d7, user_id=444c9d7d01984e33ba9b6511067b7a2c, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:43.759353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:43.773233 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1420/2836] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:43 2022] PUT /identity/v3/projects/31e34aa408e249fca651c2c413bae3d7/users/444c9d7d01984e33ba9b6511067b7a2c/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:43.778280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:43.788657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e8e0ce-4e03-4fe2-b9cf-3f97874d045f admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:43.837646 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:43.847986 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93360b86-a0a1-43a4-a522-6241d07991de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:43.848718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360b86-a0a1-43a4-a522-6241d07991de admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:43.849004 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360b86-a0a1-43a4-a522-6241d07991de admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:43.849280 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93360b86-a0a1-43a4-a522-6241d07991de admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:43.850056 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93360b86-a0a1-43a4-a522-6241d07991de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:43.851707 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93360b86-a0a1-43a4-a522-6241d07991de admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:43.861798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1417/2837] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:27:43.866023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:43.876807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc906579-361e-4b0c-82ce-271dce1e54ab admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:43.881449 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf80e41-5a07-4e1e-a2ad-9a74000d2008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:43.882326 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80e41-5a07-4e1e-a2ad-9a74000d2008 admin admin] REQUEST_METHOD: `PUT` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:43.882614 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80e41-5a07-4e1e-a2ad-9a74000d2008 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:43.882896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf80e41-5a07-4e1e-a2ad-9a74000d2008 admin admin] PATH_INFO: `/v3/projects/31e34aa408e249fca651c2c413bae3d7/users/444c9d7d01984e33ba9b6511067b7a2c/roles/44959a301b01424ea68b1b0a25c1321f` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:43.884934 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf80e41-5a07-4e1e-a2ad-9a74000d2008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e34aa408e249fca651c2c413bae3d7, user_id=444c9d7d01984e33ba9b6511067b7a2c, role_id=44959a301b01424ea68b1b0a25c1321f)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:43.888235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf80e41-5a07-4e1e-a2ad-9a74000d2008 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:43.898336 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1421/2838] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:27:43 2022] PUT /identity/v3/projects/31e34aa408e249fca651c2c413bae3d7/users/444c9d7d01984e33ba9b6511067b7a2c/roles/44959a301b01424ea68b1b0a25c1321f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:27:44.530876 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:44.531226 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:44.531519 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:44.559077 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] MFA Rules not processed for user `444c9d7d01984e33ba9b6511067b7a2c`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:44.560284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:44.645807 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1418/2839] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:44 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:44.658545 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:44.659101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:44.659101 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:44.680023 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] MFA Rules not processed for user `b3a61950bf8a4e0e81553e17531f8167`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:27:44.681408 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:44.741582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1422/2840] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:27:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:27:44.755774 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:44.757439 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:44.859481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76dfdc2-d719-4cc0-a797-b404525fb4e9 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:44.865099 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:44.865747 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:44.866038 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:44.866322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:44.874166 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:44.875749 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:44.884500 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1419/2841] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:44.917339 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:44.918737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:44.950696 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:44.999077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac2194-a6c3-4cf1-b1b0-8f3b78faa34b None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:45.002773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '18e34e8f236f4f09a456e10221e2e416', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:45.003428 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:45.003704 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:45.003981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:45.005769 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:45.020087 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:45.021597 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:45.033447 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1423/2842] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:45.233372 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:45.234786 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:45.277709 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=100 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:27:45.293082 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7592e7-a83d-482d-be1c-006b56bcaf32 service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:45.296796 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:45.297452 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:45.297740 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:45.298023 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:45.299811 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:45.309914 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:45.311347 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:45.319986 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1420/2843] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:45 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:45.652694 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:45.654097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:45.664434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:45.673416 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca323aec-b199-4353-bbce-f8c7870ad486 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:45.677091 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca787440-d57e-4856-844c-560479687772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:45.677731 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787440-d57e-4856-844c-560479687772 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:45.678018 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787440-d57e-4856-844c-560479687772 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:45.678298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca787440-d57e-4856-844c-560479687772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:45.680057 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ca787440-d57e-4856-844c-560479687772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:45.695247 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca787440-d57e-4856-844c-560479687772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:45.696708 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca787440-d57e-4856-844c-560479687772 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:45.709113 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1421/2844] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:45 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:27:45.736663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94294183-0ac4-4626-8e3b-edc72d1058b9 service glance] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:45.741699 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:45.742350 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:45.742663 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:45.742932 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:45.745440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:45.757841 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:45.759427 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:45.770388 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1424/2845] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 30 13:27:47.440351 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca787440-d57e-4856-844c-560479687772 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:47.450064 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca787440-d57e-4856-844c-560479687772 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:47.453725 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:47.454365 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:47.454654 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:47.454937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:47.456742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:47.466973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:47.468409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:47.476313 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1422/2846] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:47 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:48.149834 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:48.164164 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1be942-c806-462b-9637-dfa2ff5de649 service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:48.170367 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:48.171012 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:48.171295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:48.171571 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:48.173460 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:48.188239 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:48.189879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:48.201686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1425/2847] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:53.653022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:27:53.654498 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:53.672994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2ef31f-2dc2-446e-979f-ea4a98a7f9c5 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:27:53.678684 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5f39f1ea697c4426b30a5e6fa795e4e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:27:53.679338 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:27:53.679630 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:27:53.679918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:27:53.682359 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:27:53.700172 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:27:53.702081 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:27:53.713983 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1423/2848] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:27:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:27:58.197260 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=61 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:02.669665 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:02.671136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:02.727004 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e23a41d-4d7b-4466-b129-8627cf5081fe service nova] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:02.731345 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:02.731993 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:02.732283 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:02.732628 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:02.741750 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:02.743199 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:02.752685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1426/2849] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:03.708462 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=27 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:12.748521 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=26 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:16.191497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:16.203657 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd017923-e46e-491c-890a-db607a2591e2 service nova] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:16.208968 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:16.209612 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:16.209901 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:16.210208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:16.211986 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:16.225022 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:16.226741 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:16.238897 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1424/2850] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:16.765061 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:16.829986 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2487861-63ee-4230-96e4-f88d9dd19b38 service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:16.834994 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:16.835888 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:16.836171 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:16.836501 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] PATH_INFO: `/v3/users/b3a61950bf8a4e0e81553e17531f8167` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:16.837686 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3a61950bf8a4e0e81553e17531f8167)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:16.840121 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:16.890550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3a61950bf8a4e0e81553e17531f8167'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:16.897777 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3a61950bf8a4e0e81553e17531f8167'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:16.898448 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3a61950bf8a4e0e81553e17531f8167'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:16.899063 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3a61950bf8a4e0e81553e17531f8167'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:16.911553 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3a61950bf8a4e0e81553e17531f8167'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:16.924041 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1427/2851] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:28:16 2022] DELETE /identity/v3/users/b3a61950bf8a4e0e81553e17531f8167 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:28:17.096980 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:17.108435 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122538f9-15c1-4104-88cc-48b429b22313 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:17.169425 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:17.170301 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:17.170591 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:17.170872 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] PATH_INFO: `/v3/projects/3ee1fc0eb51945b68e470fb3f80f2a84` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:17.172125 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ee1fc0eb51945b68e470fb3f80f2a84)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:17.174104 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:17.221306 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ee1fc0eb51945b68e470fb3f80f2a84', 'request_id': 'req-cf62f5b2-6234-490e-8bc5-b8c354fe8197'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.228610 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ee1fc0eb51945b68e470fb3f80f2a84', 'request_id': 'req-cf62f5b2-6234-490e-8bc5-b8c354fe8197'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.234449 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ee1fc0eb51945b68e470fb3f80f2a84', 'request_id': 'req-cf62f5b2-6234-490e-8bc5-b8c354fe8197'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.245235 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] The token cache is being invalidate because project 3ee1fc0eb51945b68e470fb3f80f2a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:28:17.245526 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.246190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.247815 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1425/2852] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:28:17 2022] DELETE /identity/v3/projects/3ee1fc0eb51945b68e470fb3f80f2a84 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:17.251764 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:17.253196 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:17.266582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401ade4-1948-48de-a3dd-40353ae6b78e admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:17.322848 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:17.323637 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:17.324439 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:17.324735 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] PATH_INFO: `/v3/users/444c9d7d01984e33ba9b6511067b7a2c` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:17.325928 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] RBAC: Authorizing `identity:delete_user(user_id=444c9d7d01984e33ba9b6511067b7a2c)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:17.327863 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:17.349771 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:17.374985 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '444c9d7d01984e33ba9b6511067b7a2c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.381977 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '444c9d7d01984e33ba9b6511067b7a2c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.382587 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '444c9d7d01984e33ba9b6511067b7a2c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.383205 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '444c9d7d01984e33ba9b6511067b7a2c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.395442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-2bb82461-e4fd-47d5-be8e-8a511a838436 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '444c9d7d01984e33ba9b6511067b7a2c'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.408945 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1428/2853] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:28:17 2022] DELETE /identity/v3/users/444c9d7d01984e33ba9b6511067b7a2c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:17.586219 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:17.587994 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:17.601396 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62f5b2-6234-490e-8bc5-b8c354fe8197 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:17.659251 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:17.660115 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:17.660427 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:17.660712 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] PATH_INFO: `/v3/projects/31e34aa408e249fca651c2c413bae3d7` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:17.661921 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e34aa408e249fca651c2c413bae3d7)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:17.663827 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:17.686614 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:17.712711 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e34aa408e249fca651c2c413bae3d7', 'request_id': 'req-49aa000f-669d-424d-b52c-d42bd609bf30'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.719971 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e34aa408e249fca651c2c413bae3d7', 'request_id': 'req-49aa000f-669d-424d-b52c-d42bd609bf30'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.725601 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e34aa408e249fca651c2c413bae3d7', 'request_id': 'req-49aa000f-669d-424d-b52c-d42bd609bf30'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.736640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] The token cache is being invalidate because project 31e34aa408e249fca651c2c413bae3d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:28:17.736953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.737651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-49aa000f-669d-424d-b52c-d42bd609bf30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:17.739190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1426/2854] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:28:17 2022] DELETE /identity/v3/projects/31e34aa408e249fca651c2c413bae3d7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:17.744327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91923da-f20a-413f-b69f-5b60d7152dd9 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:17.744658 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91923da-f20a-413f-b69f-5b60d7152dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:17.744971 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91923da-f20a-413f-b69f-5b60d7152dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:17.764219 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c91923da-f20a-413f-b69f-5b60d7152dd9 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:17.765543 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c91923da-f20a-413f-b69f-5b60d7152dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:17.825221 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1429/2855] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:17.835742 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dabef-8a3c-435b-85ea-169d49f818ad None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:17.835945 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dabef-8a3c-435b-85ea-169d49f818ad None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:17.836231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79dabef-8a3c-435b-85ea-169d49f818ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:17.854689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-c79dabef-8a3c-435b-85ea-169d49f818ad None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:17.855900 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c79dabef-8a3c-435b-85ea-169d49f818ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:17.863857 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1427/2856] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:17.868028 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91923da-f20a-413f-b69f-5b60d7152dd9 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:17.878417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91923da-f20a-413f-b69f-5b60d7152dd9 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:17.882981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:17.883636 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:17.883926 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:17.884210 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:17.885007 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:28:17.885321 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:17.887634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:17.899237 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1430/2857] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:28:17.903718 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dabef-8a3c-435b-85ea-169d49f818ad None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:17.913002 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79dabef-8a3c-435b-85ea-169d49f818ad None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:17.918167 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:17.918899 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:17.919194 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:17.919477 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:17.920178 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:17.922136 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:17.950750 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1428/2858] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:28:17 2022] POST /identity/v3/projects => generated 359 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:28:17.951909 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:17.961854 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b755ea-6783-45e1-aa7f-0caa18494fa7 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:18.019156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:18.019821 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.020107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.020414 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.021091 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:18.023077 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:18.042550 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1431/2859] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:28:17 2022] POST /identity/v3/users => generated 280 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:28:18.046883 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:18.057127 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dabf30-36fa-4d66-a09b-c1d52441f096 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:18.063891 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:18.064581 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.064892 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.065214 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.065948 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:18.067546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:18.078284 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1429/2860] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:28:18.082015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:18.092270 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b8cd1-7565-466b-8114-c1a1a1bcde75 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:18.096846 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b36b0a9-446c-4891-b9e6-6f1ead6f576f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:18.097495 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b0a9-446c-4891-b9e6-6f1ead6f576f admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.097786 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b0a9-446c-4891-b9e6-6f1ead6f576f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.098074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b36b0a9-446c-4891-b9e6-6f1ead6f576f admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.098838 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b0a9-446c-4891-b9e6-6f1ead6f576f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:18.100766 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b36b0a9-446c-4891-b9e6-6f1ead6f576f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:18.111420 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1432/2861] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:28:18.115408 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:18.126389 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde30f17-dbf7-4ebc-a78d-2f0465804ac1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:18.131345 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:18.132264 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.132668 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.132951 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] PATH_INFO: `/v3/projects/ef59772a5f3c47ea9ab1a1266b70051d/users/adc254b3a8e54117a7b28a3642330ea3/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.154820 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef59772a5f3c47ea9ab1a1266b70051d, user_id=adc254b3a8e54117a7b28a3642330ea3, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:18.159270 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:18.176556 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1430/2862] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:28:18 2022] PUT /identity/v3/projects/ef59772a5f3c47ea9ab1a1266b70051d/users/adc254b3a8e54117a7b28a3642330ea3/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:18.187362 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213516fa-98ea-410a-80a1-b8ac8dec65b9 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.187657 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213516fa-98ea-410a-80a1-b8ac8dec65b9 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.187940 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213516fa-98ea-410a-80a1-b8ac8dec65b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.194758 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:18.215820 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-213516fa-98ea-410a-80a1-b8ac8dec65b9 None None] MFA Rules not processed for user `adc254b3a8e54117a7b28a3642330ea3`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:18.217107 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-213516fa-98ea-410a-80a1-b8ac8dec65b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:18.281671 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1433/2863] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:18.313550 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:18.316838 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:18.375318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c770ce69-166e-4374-b183-0a4036e0d62b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:18.378868 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5f83b-7a01-4959-a6d1-8249c7fbc1c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:18.379507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f83b-7a01-4959-a6d1-8249c7fbc1c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.379788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f83b-7a01-4959-a6d1-8249c7fbc1c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.380069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5f83b-7a01-4959-a6d1-8249c7fbc1c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.389635 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5f83b-7a01-4959-a6d1-8249c7fbc1c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:18.391086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5f83b-7a01-4959-a6d1-8249c7fbc1c6 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:18.400141 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1431/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:18.414020 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213516fa-98ea-410a-80a1-b8ac8dec65b9 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:18.478576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213516fa-98ea-410a-80a1-b8ac8dec65b9 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:18.484763 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:18.485653 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.485946 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.486231 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] PATH_INFO: `/v3/users/adc254b3a8e54117a7b28a3642330ea3` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.487462 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc254b3a8e54117a7b28a3642330ea3)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:18.489440 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:18.539907 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc254b3a8e54117a7b28a3642330ea3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:18.547112 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc254b3a8e54117a7b28a3642330ea3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:18.547843 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc254b3a8e54117a7b28a3642330ea3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:18.548482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc254b3a8e54117a7b28a3642330ea3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:18.561303 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc254b3a8e54117a7b28a3642330ea3'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:18.573235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1434/2865] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:28:18 2022] DELETE /identity/v3/users/adc254b3a8e54117a7b28a3642330ea3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:18.578756 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.579055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.579342 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.595984 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:18.597222 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:18.638625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:18.657580 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1432/2866] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:18.668896 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:18.670197 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:18.684720 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:18.729327 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7fa8b2-9fab-4bef-b043-93271b4be194 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:18.733709 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a680bf2-59bc-4316-8483-fb925b687f90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:18.734368 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a680bf2-59bc-4316-8483-fb925b687f90 service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:18.734659 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a680bf2-59bc-4316-8483-fb925b687f90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:18.734943 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a680bf2-59bc-4316-8483-fb925b687f90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:18.744010 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a680bf2-59bc-4316-8483-fb925b687f90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:18.745491 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a680bf2-59bc-4316-8483-fb925b687f90 service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:18.755093 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1435/2867] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:19.023842 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.025600 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:19.039145 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c564975-abd2-4e81-9195-eb83d1e18aca None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.044069 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.045061 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.045412 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.045759 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] PATH_INFO: `/v3/projects/ef59772a5f3c47ea9ab1a1266b70051d` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.047024 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef59772a5f3c47ea9ab1a1266b70051d)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.049233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.097110 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef59772a5f3c47ea9ab1a1266b70051d', 'request_id': 'req-e66681e9-304e-411e-8d37-563d837ddf90'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:19.104318 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef59772a5f3c47ea9ab1a1266b70051d', 'request_id': 'req-e66681e9-304e-411e-8d37-563d837ddf90'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:19.110062 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef59772a5f3c47ea9ab1a1266b70051d', 'request_id': 'req-e66681e9-304e-411e-8d37-563d837ddf90'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:19.121507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] The token cache is being invalidate because project ef59772a5f3c47ea9ab1a1266b70051d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:28:19.122088 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:19.122450 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-e66681e9-304e-411e-8d37-563d837ddf90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:19.124001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1433/2868] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:28:19 2022] DELETE /identity/v3/projects/ef59772a5f3c47ea9ab1a1266b70051d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:19.129285 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c75a9-0e76-47d2-8915-edb022c2a3ba None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.129791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c75a9-0e76-47d2-8915-edb022c2a3ba None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.129899 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275c75a9-0e76-47d2-8915-edb022c2a3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.148079 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-275c75a9-0e76-47d2-8915-edb022c2a3ba None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:19.149235 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-275c75a9-0e76-47d2-8915-edb022c2a3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:19.208201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1436/2869] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:19.215934 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eb0bd-3989-428c-bce4-049f9e35c725 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.216231 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eb0bd-3989-428c-bce4-049f9e35c725 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.216557 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1eb0bd-3989-428c-bce4-049f9e35c725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.234392 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-6d1eb0bd-3989-428c-bce4-049f9e35c725 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:19.235597 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-6d1eb0bd-3989-428c-bce4-049f9e35c725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:19.243551 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1434/2870] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:19.248471 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c75a9-0e76-47d2-8915-edb022c2a3ba None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.257917 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275c75a9-0e76-47d2-8915-edb022c2a3ba None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.263148 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.263791 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.264074 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.264351 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.265106 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:28:19.265413 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.267019 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.278634 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1437/2871] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:28:19.282773 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1eb0bd-3989-428c-bce4-049f9e35c725 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.292054 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1eb0bd-3989-428c-bce4-049f9e35c725 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.297001 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.297645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.297926 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.298213 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.298937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.300864 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.327467 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1435/2872] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:28:19 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 30 13:28:19.331372 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.341126 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b7f8ce-b2d0-4034-beef-3d4167e81b53 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.397280 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.397933 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.398271 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.398493 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.399185 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.401381 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.421921 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1438/2873] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:28:19 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:28:19.425861 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.437078 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08941280-9744-458c-99a6-40e19d37c4d9 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.441641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.442297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.442584 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.442865 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.443587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.445204 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.455437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1436/2874] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:28:19.459524 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.470118 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4778de7-7880-4c70-8d7c-0b4c55b6bc7c admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.474727 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa25136-10c2-4a87-ac06-6f1ec0fa12e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.475383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25136-10c2-4a87-ac06-6f1ec0fa12e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.475669 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25136-10c2-4a87-ac06-6f1ec0fa12e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.475952 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa25136-10c2-4a87-ac06-6f1ec0fa12e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.476740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25136-10c2-4a87-ac06-6f1ec0fa12e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.478310 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa25136-10c2-4a87-ac06-6f1ec0fa12e7 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.488611 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1439/2875] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:28:19.492587 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.503255 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62aee5f-146c-4327-a711-a9e681708f96 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.507953 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.508859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.509146 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.509433 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] PATH_INFO: `/v3/projects/6f569b0b69254398bdb7f375115dc216/users/3d885268e0b54bfb8f2839750243720b/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.524918 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f569b0b69254398bdb7f375115dc216, user_id=3d885268e0b54bfb8f2839750243720b, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.527569 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.541098 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1437/2876] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:28:19 2022] PUT /identity/v3/projects/6f569b0b69254398bdb7f375115dc216/users/3d885268e0b54bfb8f2839750243720b/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:19.553287 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85ba15-2c2e-45b6-878f-32e78647c4f5 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.553607 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85ba15-2c2e-45b6-878f-32e78647c4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.553890 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc85ba15-2c2e-45b6-878f-32e78647c4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.705036 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-fc85ba15-2c2e-45b6-878f-32e78647c4f5 None None] MFA Rules not processed for user `3d885268e0b54bfb8f2839750243720b`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:19.706301 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-fc85ba15-2c2e-45b6-878f-32e78647c4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:19.715593 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:19.770465 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1440/2877] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:19.782543 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:19.784216 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:19.842233 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbcb224-b870-47d3-92ee-80ddc0ccddd1 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:19.845855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95595eb5-132f-4eeb-b664-ee4017905c67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:19.846507 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595eb5-132f-4eeb-b664-ee4017905c67 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:19.846798 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595eb5-132f-4eeb-b664-ee4017905c67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:19.847086 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95595eb5-132f-4eeb-b664-ee4017905c67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:19.855950 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95595eb5-132f-4eeb-b664-ee4017905c67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:19.857413 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95595eb5-132f-4eeb-b664-ee4017905c67 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:19.866232 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1438/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:29.516740 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85ba15-2c2e-45b6-878f-32e78647c4f5 None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:29.579591 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc85ba15-2c2e-45b6-878f-32e78647c4f5 None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:29.584183 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:29.585090 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:29.585383 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:29.585666 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] PATH_INFO: `/v3/users/3d885268e0b54bfb8f2839750243720b` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:29.586867 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d885268e0b54bfb8f2839750243720b)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:29.588840 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:29.637598 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d885268e0b54bfb8f2839750243720b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:29.645807 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d885268e0b54bfb8f2839750243720b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:29.646393 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d885268e0b54bfb8f2839750243720b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:29.647009 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d885268e0b54bfb8f2839750243720b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:29.659200 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d885268e0b54bfb8f2839750243720b'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:29.671204 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1441/2879] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:28:29 2022] DELETE /identity/v3/users/3d885268e0b54bfb8f2839750243720b => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:29.675641 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:29.676143 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:29.676257 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:29.693480 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:29.694696 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:29.698649 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:29.755536 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1439/2880] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:29.765156 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:29.766565 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:29.805097 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:29.831910 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee662b4b-1c13-40c9-9504-e12b768ea0ef admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:29.835578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752b782-fb21-4341-bb78-061bce96269d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:29.836236 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752b782-fb21-4341-bb78-061bce96269d service neutron] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:29.836570 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752b782-fb21-4341-bb78-061bce96269d service neutron] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:29.836855 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752b782-fb21-4341-bb78-061bce96269d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:29.846609 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752b782-fb21-4341-bb78-061bce96269d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:29.848045 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752b782-fb21-4341-bb78-061bce96269d service neutron] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:29.857582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1442/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:30.129486 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.131005 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:30.146673 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8475575b-817d-4a05-a22b-c0150d29b2c2 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.153055 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.154463 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.154939 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.155924 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] PATH_INFO: `/v3/projects/6f569b0b69254398bdb7f375115dc216` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.158163 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f569b0b69254398bdb7f375115dc216)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.161687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.208655 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f569b0b69254398bdb7f375115dc216', 'request_id': 'req-4050aae4-446c-4107-9d2c-f19c005088dd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:30.215676 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f569b0b69254398bdb7f375115dc216', 'request_id': 'req-4050aae4-446c-4107-9d2c-f19c005088dd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:30.222246 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f569b0b69254398bdb7f375115dc216', 'request_id': 'req-4050aae4-446c-4107-9d2c-f19c005088dd'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:30.234381 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] The token cache is being invalidate because project 6f569b0b69254398bdb7f375115dc216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80104) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:28:30.234678 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:30.235320 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-4050aae4-446c-4107-9d2c-f19c005088dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:28:30.241424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1440/2882] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:28:30 2022] DELETE /identity/v3/projects/6f569b0b69254398bdb7f375115dc216 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:30.246416 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4899d-844a-4cf3-9897-1a62470c356e None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.246713 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4899d-844a-4cf3-9897-1a62470c356e None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.246996 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a4899d-844a-4cf3-9897-1a62470c356e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.268051 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-68a4899d-844a-4cf3-9897-1a62470c356e None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:30.269241 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-68a4899d-844a-4cf3-9897-1a62470c356e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:30.330021 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1443/2883] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:30.337814 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b68d9-01e3-4cd8-8555-713db3999493 None None] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.338112 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b68d9-01e3-4cd8-8555-713db3999493 None None] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.338398 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2b68d9-01e3-4cd8-8555-713db3999493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.357640 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.auth.core [None req-fe2b68d9-01e3-4cd8-8555-713db3999493 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80104) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:30.359460 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-fe2b68d9-01e3-4cd8-8555-713db3999493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:30.367382 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1441/2884] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:30.371539 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4899d-844a-4cf3-9897-1a62470c356e None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.381258 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a4899d-844a-4cf3-9897-1a62470c356e None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.386269 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.386922 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.387212 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.387497 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] PATH_INFO: `/v3/domains` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.388225 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80103) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 30 13:28:30.388577 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.390401 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.402102 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1444/2885] 10.222.0.20 () {58 vars in 1152 bytes} [Thu Jun 30 13:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 30 13:28:30.406660 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b68d9-01e3-4cd8-8555-713db3999493 None None] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.415835 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2b68d9-01e3-4cd8-8555-713db3999493 None None] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.420442 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.421642 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.421930 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.422208 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.422888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.424791 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.449790 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1442/2886] 10.222.0.20 () {60 vars in 1152 bytes} [Thu Jun 30 13:28:30 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:28:30.454015 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.463833 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbdde8-6972-4583-b688-528ab1d6bbef admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.522276 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.523340 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.523773 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.524057 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] PATH_INFO: `/v3/users` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.525054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.527244 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.548136 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1445/2887] 10.222.0.20 () {60 vars in 1143 bytes} [Thu Jun 30 13:28:30 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 30 13:28:30.552298 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.562795 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1fb9fd-b45e-4e8c-9023-1b16429ff9c4 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.567434 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.568097 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.568415 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.568703 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.569430 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.571021 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.581832 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1443/2888] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:28:30.585802 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.596017 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fc7ed-3453-4e41-a7c3-2a0c3b010d15 admin admin] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.600606 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3969d3-4615-4b69-8c15-ac54d87bbe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.601252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3969d3-4615-4b69-8c15-ac54d87bbe9f admin admin] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.601535 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3969d3-4615-4b69-8c15-ac54d87bbe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.601808 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3969d3-4615-4b69-8c15-ac54d87bbe9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.602532 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3969d3-4615-4b69-8c15-ac54d87bbe9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.604109 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3969d3-4615-4b69-8c15-ac54d87bbe9f admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.616576 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1446/2889] 10.222.0.20 () {58 vars in 1121 bytes} [Thu Jun 30 13:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 30 13:28:30.618157 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.628010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae82da-9dac-4988-a29a-e1d56c21fe04 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.632542 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.633409 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] REQUEST_METHOD: `PUT` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.633693 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.633977 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] PATH_INFO: `/v3/projects/bd1af9c56957466fb15ed71af9eb7e8b/users/e4698e0df52e4cb6b31a9f650e3c395a/roles/60b18f6f37f34c88be6d03d808bc0d04` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.649619 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd1af9c56957466fb15ed71af9eb7e8b, user_id=e4698e0df52e4cb6b31a9f650e3c395a, role_id=60b18f6f37f34c88be6d03d808bc0d04)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.652224 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.665424 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1444/2890] 10.222.0.20 () {60 vars in 1482 bytes} [Thu Jun 30 13:28:30 2022] PUT /identity/v3/projects/bd1af9c56957466fb15ed71af9eb7e8b/users/e4698e0df52e4cb6b31a9f650e3c395a/roles/60b18f6f37f34c88be6d03d808bc0d04 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:28:30.673826 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f948-16e3-422d-be7e-d3aaad889704 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.674114 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f948-16e3-422d-be7e-d3aaad889704 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.674395 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b563f948-16e3-422d-be7e-d3aaad889704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.691633 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-b563f948-16e3-422d-be7e-d3aaad889704 None None] MFA Rules not processed for user `ae10d7aab4ac4b9b82fea4d07e2038f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:30.692861 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-b563f948-16e3-422d-be7e-d3aaad889704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:30.727981 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:30.754451 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1447/2891] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:30.764133 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:30.766485 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:30.798999 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:30.827546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36beb9-4a41-4b89-bc0c-ba863642d875 admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:30.831475 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:30.832118 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:30.832437 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:30.832724 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:30.841663 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:30.844190 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:30.853627 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1445/2892] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:31.493776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419be5-aa0f-4554-8cc1-ec3d0239eb43 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:31.494071 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419be5-aa0f-4554-8cc1-ec3d0239eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:31.494349 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca419be5-aa0f-4554-8cc1-ec3d0239eb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:31.521330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-ca419be5-aa0f-4554-8cc1-ec3d0239eb43 None None] MFA Rules not processed for user `e4698e0df52e4cb6b31a9f650e3c395a`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:31.522688 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-ca419be5-aa0f-4554-8cc1-ec3d0239eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:31.590070 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1448/2893] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:31.601371 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:31.602788 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:31.660973 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b135d1-1864-4b51-bb65-482c41a1dec8 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:31.664647 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:31.669297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:31.669297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:31.669297 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:31.677755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:31.679177 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:31.688689 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1446/2894] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:33.035397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352eea-2ca4-41cd-920c-18dc5e7be862 None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:33.035397 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352eea-2ca4-41cd-920c-18dc5e7be862 None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:33.035905 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352eea-2ca4-41cd-920c-18dc5e7be862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:33.053029 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-c9352eea-2ca4-41cd-920c-18dc5e7be862 None None] MFA Rules not processed for user `e4698e0df52e4cb6b31a9f650e3c395a`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:28:33.054246 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-c9352eea-2ca4-41cd-920c-18dc5e7be862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:33.061172 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1449/2895] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:28:33 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:28:33.305546 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:28:33.306998 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:33.319651 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0c2a95-ce0e-42df-b22b-543683aaa3d4 service cinder] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:28:33.323241 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:28:33.323912 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:28:33.324201 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:28:33.324528 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:28:33.326259 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:28:33.336187 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:28:33.337652 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:28:33.346108 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1447/2896] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:28:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:28:43.047846 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=44 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:28:43.342206 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=45 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:29:02.815737 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] REQUEST_METHOD: `POST` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:29:02.816252 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:29:02.816370 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:29:02.833385 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.auth.core [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] MFA Rules not processed for user `e4698e0df52e4cb6b31a9f650e3c395a`. Rule list: `[]` (Enabled: `True`). {{(pid=80103) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 30 13:29:02.834578 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:29:02.841365 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1450/2897] 10.222.0.20 () {58 vars in 957 bytes} [Thu Jun 30 13:29:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 30 13:29:12.828330 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=3 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:31:07.040886 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:31:07.042289 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:07.130802 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dedd223-7811-4e00-8755-7cd06d896d3a service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:31:07.136628 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:31:07.137275 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:31:07.137566 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:31:07.137855 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:31:07.139625 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:31:07.151495 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:31:07.153102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:31:07.162985 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1448/2898] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:31:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:31:17.158645 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=41 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:33:31.611987 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:33:31.613411 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:33:31.650443 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a71e85-b8a8-4588-9571-388f9445bead None None] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:33:31.654048 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6290142aced542e19cc4b23ab34a3d03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:33:31.654685 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:33:31.654972 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:33:31.655251 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:33:31.663417 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:33:31.664920 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:33:31.674760 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1451/2899] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:33:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:33:41.670341 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=17 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:35:30.968943 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:35:30.978481 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2e34-0150-4600-be14-723a7493e100 service placement] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:35:30.982797 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b35298e764904e9884012cafea48a794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:35:30.983648 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:35:30.983937 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:35:30.984215 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:35:30.994310 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:35:30.995809 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:35:31.005751 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1449/2900] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:35:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:35:31.473135 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:35:31.474579 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:35:31.489127 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc903b0-311d-4fd8-8798-75a30a8855ea service cinder] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:35:31.494353 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:35:31.495152 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] REQUEST_METHOD: `GET` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:35:31.495442 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:35:31.495721 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:35:31.497511 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.fernet_utils [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80103) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:35:31.511482 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:35:31.513154 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:35:31.524638 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:35:31.535879 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1452/2901] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:35:31 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:35:31.536192 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1a12d-b3ed-43f1-bd9c-66a440c741e7 service neutron] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:35:31.541867 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:35:31.542754 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:35:31.543354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:35:31.543354 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] PATH_INFO: `/v3/users/e4698e0df52e4cb6b31a9f650e3c395a` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:35:31.544538 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4698e0df52e4cb6b31a9f650e3c395a)` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:35:31.546447 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:35:31.595200 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4698e0df52e4cb6b31a9f650e3c395a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.602102 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4698e0df52e4cb6b31a9f650e3c395a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.614012 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4698e0df52e4cb6b31a9f650e3c395a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.614639 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4698e0df52e4cb6b31a9f650e3c395a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.621755 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.notifications [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4698e0df52e4cb6b31a9f650e3c395a'} {{(pid=80104) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.628687 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1450/2902] 10.222.0.20 () {58 vars in 1223 bytes} [Thu Jun 30 13:35:31 2022] DELETE /identity/v3/users/e4698e0df52e4cb6b31a9f650e3c395a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 30 13:35:31.810157 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] Authenticating user token {{(pid=80103) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:35:31.828607 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cc2d8a-69bb-4c5c-b07b-eb2ab51849d4 service placement] Validating token access rules against request {{(pid=80103) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:35:31.892434 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ae10d7aab4ac4b9b82fea4d07e2038f9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '164f9c2181684cbfbef84aef48504d33', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80103) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:35:31.893295 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:35:31.893582 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:35:31.893860 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] PATH_INFO: `/v3/projects/bd1af9c56957466fb15ed71af9eb7e8b` {{(pid=80103) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:35:31.895054 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd1af9c56957466fb15ed71af9eb7e8b)` {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:35:31.897016 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] RBAC: Authorization granted {{(pid=80103) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:35:31.942522 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd1af9c56957466fb15ed71af9eb7e8b', 'request_id': 'req-c38bac08-9935-4ab0-8f28-5af929b611c1'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.948412 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd1af9c56957466fb15ed71af9eb7e8b', 'request_id': 'req-c38bac08-9935-4ab0-8f28-5af929b611c1'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.955842 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd1af9c56957466fb15ed71af9eb7e8b', 'request_id': 'req-c38bac08-9935-4ab0-8f28-5af929b611c1'} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.965779 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] The token cache is being invalidate because project bd1af9c56957466fb15ed71af9eb7e8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80103) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 30 13:35:31.966069 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.966776 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG keystone.notifications [None req-c38bac08-9935-4ab0-8f28-5af929b611c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80103) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 30 13:35:31.968201 dv-cinder-822821-3-smb devstack@keystone.service[80103]: [pid: 80103|app: 0|req: 1453/2903] 10.222.0.20 () {58 vars in 1232 bytes} [Thu Jun 30 13:35:31 2022] DELETE /identity/v3/projects/bd1af9c56957466fb15ed71af9eb7e8b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 30 13:35:41.625010 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=35,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:35:41.962892 dv-cinder-822821-3-smb devstack@keystone.service[80103]: DEBUG dbcounter [-] [80103] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80103) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 30 13:36:12.022590 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Authenticating user token {{(pid=80104) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 30 13:36:12.024103 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:36:12.144323 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b6623-1b67-42ba-b83f-e68756b2b74b admin admin] Validating token access rules against request {{(pid=80104) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 30 13:36:12.203239 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625bfb8-f36d-454b-a30d-c684fbafedef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fb592cacc3b1469fb6e64254f1fcf285', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8aadca03ef0a4218868f16b997ec248e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80104) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 30 13:36:12.203888 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625bfb8-f36d-454b-a30d-c684fbafedef service placement] REQUEST_METHOD: `GET` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 30 13:36:12.204176 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625bfb8-f36d-454b-a30d-c684fbafedef service placement] SCRIPT_NAME: `/identity` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 30 13:36:12.204497 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625bfb8-f36d-454b-a30d-c684fbafedef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80104) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 30 13:36:12.206295 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.fernet_utils [None req-d625bfb8-f36d-454b-a30d-c684fbafedef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80104) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 30 13:36:12.217322 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625bfb8-f36d-454b-a30d-c684fbafedef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 30 13:36:12.219015 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625bfb8-f36d-454b-a30d-c684fbafedef service placement] RBAC: Authorization granted {{(pid=80104) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 30 13:36:12.228859 dv-cinder-822821-3-smb devstack@keystone.service[80104]: [pid: 80104|app: 0|req: 1451/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Thu Jun 30 13:36:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 30 13:36:22.225677 dv-cinder-822821-3-smb devstack@keystone.service[80104]: DEBUG dbcounter [-] [80104] Writing DB stats keystone:SELECT=80 {{(pid=80104) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}